-- Logs begin at Thu 2022-05-19 15:41:33 UTC, end at Thu 2022-05-19 17:10:29 UTC. -- May 19 16:33:12.352518 dv-cinder-842433-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 16:33:12.361989 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 16:33:12 2022] *** May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: nodename: dv-cinder-842433-1-iscsi May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: machine: x86_64 May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: clock source: unix May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: pcre jit disabled May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: detected number of CPU cores: 4 May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: current working directory: / May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: detected binary path: /usr/bin/uwsgi-core May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: your processes number limit is 47680 May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: your memory page size is 4096 bytes May 19 16:33:12.364052 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: detected max file descriptor number: 2048 May 19 16:33:12.366176 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: lock engine: pthread robust mutexes May 19 16:33:12.366176 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: thunder lock: enabled May 19 16:33:12.366176 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 16:33:12.366176 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 16:33:12.411981 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: Python main interpreter initialized at 0x562dc6b239c0 May 19 16:33:12.411981 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: python threads support enabled May 19 16:33:12.411981 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: your server socket listen backlog is limited to 100 connections May 19 16:33:12.411981 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: your mercy for graceful operations on workers is 90 seconds May 19 16:33:12.412681 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: mapped 403077 bytes (393 KB) for 2 cores May 19 16:33:12.412681 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: *** Operational MODE: preforking *** May 19 16:33:12.412893 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: *** uWSGI is running in multiple interpreter mode *** May 19 16:33:12.412893 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: spawned uWSGI master process (pid: 109625) May 19 16:33:12.415111 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: spawned uWSGI worker 1 (pid: 109626, cores: 1) May 19 16:33:12.415111 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: spawned uWSGI worker 2 (pid: 109627, cores: 1) May 19 16:33:12.415111 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 16:33:12.413001 dv-cinder-842433-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 16:33:13.663647 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 16:33:13.759920 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 16:33:14.420156 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:33:14.420156 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: from cryptography.utils import int_from_bytes May 19 16:33:14.420796 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:33:14.420796 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: from cryptography.utils import int_from_bytes May 19 16:33:14.530411 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:33:14.530411 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: from cryptography.utils import int_from_bytes May 19 16:33:14.530805 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:33:14.530805 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: from cryptography.utils import int_from_bytes May 19 16:33:17.147286 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 16:33:17.148090 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 16:33:17.148090 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 16:33:17.148379 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 16:33:17.148535 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 16:33:17.148938 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.149305 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.149631 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.149950 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.150286 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.150598 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.150925 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.151246 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.151577 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.151840 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.152158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.152486 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842433-1-iscsi {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.152810 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.153116 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.153460 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.153784 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.154089 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.154414 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.154722 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.155230 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.155815 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.156018 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.156274 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.156658 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.157129 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.157397 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.157614 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.157906 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.158218 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.158532 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.158942 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842433-1-iscsi {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.159262 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.159574 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.159888 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.160317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.160629 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.160941 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.161306 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.161644 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.161960 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.162292 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.162613 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.162934 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.163255 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.163557 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.163768 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 16:33:17.164483 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.164691 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 16:33:17.164899 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.164899 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.165349 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 16:33:17.165548 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.165781 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 16:33:17.165987 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.166198 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 16:33:17.166431 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.166626 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.166829 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.167022 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.167218 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.167428 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.167631 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.167833 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.168038 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.168249 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.168460 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.168460 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.168835 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.169035 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.169278 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.169473 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.169676 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.169880 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.170076 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.170076 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.170482 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.170694 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.170885 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.171077 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842433-1-iscsi {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.171278 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.171483 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.171694 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.171694 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.172070 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.172271 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.172783 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.172993 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.173223 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.173418 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.173626 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.173833 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.173833 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.174224 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.174224 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.174608 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.174836 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.175039 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.175356 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.175561 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.175756 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.175964 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.176155 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.176363 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.176609 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.176860 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.177062 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.177295 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.177484 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.177995 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.178186 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.178394 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.178593 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.178798 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.178989 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.179203 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.179453 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.179660 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842433-1-iscsi {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.179855 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.180075 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.180266 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.180467 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.180683 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.180873 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.181078 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.181078 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.181491 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.181686 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.181893 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.182101 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.182319 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.182515 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.182758 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.182965 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.183154 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.183342 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.183553 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.183757 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.183952 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.184139 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.184327 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.184517 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.184517 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.184904 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.185110 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.185322 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.185486 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.185664 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.185841 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.186013 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.186174 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.186366 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.186556 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.186757 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.186945 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.187120 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.187292 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.187476 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.187476 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.187853 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.188043 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.188238 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.188457 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.188645 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.188832 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.189040 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.189040 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.189454 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.189454 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.189853 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.190053 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.190263 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.190453 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.190660 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.190850 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.191054 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.191263 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.191468 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.191671 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.191873 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.192071 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.192270 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.192482 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.193270 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.193487 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.193687 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.193920 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.194087 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.194278 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.194448 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.194625 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.194791 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.194957 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.195143 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.195313 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.195508 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.195687 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.195875 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.196080 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.196449 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.196651 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.196856 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.197064 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.197279 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.197478 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.197699 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.197904 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.198112 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.198465 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.198692 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.198890 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.199094 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.199277 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.199469 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.199469 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.199998 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.200208 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.200399 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.200591 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.200778 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.200977 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.201215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.201434 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.201645 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.201850 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.202042 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.202368 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.202540 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.202715 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.202875 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.202875 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.203219 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.203417 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.203590 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.203785 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.203968 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.204144 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.204351 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.204544 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.204760 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.204957 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.205172 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.205384 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.205573 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.205761 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.205962 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.206166 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.206362 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.206548 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.206734 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.206931 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.207131 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.207319 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.207513 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.207699 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.207882 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.208070 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.208872 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.209070 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.209276 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.209455 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.209643 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.209939 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.210134 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.210324 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.210523 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.210746 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.210936 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.211290 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.211498 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.211689 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.211877 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.212064 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.212269 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.212464 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.212675 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.212860 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.213053 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.213329 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.213329 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.213708 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.213904 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.214111 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.214308 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.214512 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.214724 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.214933 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.215119 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.215312 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.215503 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.215700 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.215890 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.216094 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.216285 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.216473 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.216659 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.216857 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.217063 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.217279 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.217474 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.217662 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.217847 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.218035 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.218242 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.218442 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.218629 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.218829 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.219026 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.219253 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.219452 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.219653 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.219834 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.220027 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.220219 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.220409 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.220618 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.220821 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.221010 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.221416 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.221621 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.221811 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.222015 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.222203 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.222396 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.222580 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.222796 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.222989 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.223201 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.223388 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.223589 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:33:17.223790 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.224473 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.224659 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.224862 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.225049 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.225257 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.225449 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.225662 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.225871 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.226066 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.226261 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.226449 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.226643 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.226855 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.227068 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.227263 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.227486 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.227681 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.227875 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.228071 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.228295 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.228491 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.228694 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.228887 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.229079 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.229350 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.229543 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.229741 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.229920 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.230112 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.230325 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.230538 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.230729 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.230930 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.231140 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.231341 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.231541 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.231752 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.231942 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.232153 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.232353 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.232600 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.232795 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.233001 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.233224 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.233419 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.233631 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.233828 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.234017 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.234224 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.234430 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.234624 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.234825 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.235012 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.235225 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.235225 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.235585 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.235585 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.235961 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.236168 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.236391 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.236582 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.236776 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.236966 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.237210 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.237408 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.237623 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.237829 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.238032 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.238237 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.238433 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.238628 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.238944 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.239150 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.239343 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.239669 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.240363 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.240576 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.240765 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.240960 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.241219 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.241409 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.241598 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.241598 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.242147 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.242360 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.242569 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.242766 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.242953 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.243167 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.243717 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.243914 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.244108 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.244316 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.244511 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.244719 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.244915 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.245111 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.245393 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.245611 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.245823 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.245823 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.246185 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.246185 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.246573 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.246777 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.246991 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.247185 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.247383 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.247578 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.247774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.247968 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.248186 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.248186 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.248558 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.248558 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.248950 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.249179 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.249392 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.249392 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.249755 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.249951 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.250141 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.250349 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.250535 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.250739 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.250928 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.251116 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.251367 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.251568 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.251753 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.251938 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.252127 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.252317 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.252528 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.252731 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.252919 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.253104 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.253341 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.253531 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.253718 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.253931 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.254141 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.254352 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.254555 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.254745 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.254944 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.255170 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.255364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.255554 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.255740 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.255916 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.256123 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.256317 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.256543 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.256888 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.257104 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.257366 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.257581 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.257772 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.257979 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.258176 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.258530 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.258727 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.258916 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.259126 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.259321 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.259518 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.259714 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.259907 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.260104 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.260308 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.260500 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.260704 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.260874 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.261030 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.261195 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.261337 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.261472 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.261617 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.261751 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.261890 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.262026 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.262160 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.262302 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.262428 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.262565 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.263142 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.263337 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.263540 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.263730 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.263926 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.264121 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.264327 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.264524 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.264721 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.264917 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.265115 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.265374 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.265568 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.265762 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.265950 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.266125 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.266318 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.266530 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.266721 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.266916 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.267125 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.267337 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.267529 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.267733 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.267969 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.268157 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.268388 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.268576 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.268770 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.268985 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.269208 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.269404 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.269620 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.269829 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.270041 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.270244 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.270446 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.270633 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.270860 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.271041 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.271258 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.271440 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.271627 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.271816 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.272008 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.272202 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.272414 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.272590 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.272774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.272978 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.273193 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.273420 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.273624 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.273816 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.274009 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.274349 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.274545 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.274767 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.274975 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.275181 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.275380 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.275573 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.275761 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.275972 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.276181 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.276376 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.276565 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.276757 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.276946 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.277368 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.277569 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.277780 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.277972 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.278178 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.278364 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.278566 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.278753 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.278956 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.279144 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.279389 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.279578 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.279798 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.279997 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.280189 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.280396 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.280587 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.280783 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.280971 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.281144 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.281357 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.281545 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.281737 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.281950 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.282156 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.282346 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.282554 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.282746 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.282941 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.283178 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.283365 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.283705 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.283913 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.284102 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.284102 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.284495 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.284703 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.284901 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.285101 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.285373 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.285591 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.285792 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.285989 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.286190 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.286912 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.287104 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.287312 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.287505 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.287709 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.287899 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.288096 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.288298 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.288511 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.288714 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.288906 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.289103 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.289324 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.289508 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.289715 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.289922 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.290112 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.290286 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.290476 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.290663 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.290858 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.291065 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.291254 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.291442 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.291635 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.291831 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.292048 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.292243 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.292443 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.292633 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.292834 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.293018 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.293265 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.293462 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.293655 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.293847 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.294036 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.294232 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.294441 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.294646 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.294852 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.295048 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.295239 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.295445 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.295639 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.295786 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.295929 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.296083 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.296226 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.296382 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.296513 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.296645 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.296798 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.296934 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.297079 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.297291 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.297432 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.297582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.297720 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.297854 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.297999 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.298152 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.298287 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.298435 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.298564 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.298701 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.298849 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299010 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299154 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299297 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299446 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299576 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299723 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.299998 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.300135 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.300275 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.300412 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.300561 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.300710 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.300859 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.300992 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.301127 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.301295 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.301464 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.301588 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.301700 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.301798 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.301907 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.302664 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.302798 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.302917 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.302917 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.303266 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.303390 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.303527 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.303632 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.303750 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.303863 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.304157 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.304300 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.304454 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.304598 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.304738 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.304876 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.305101 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.305298 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.305497 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.305644 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.305783 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.305927 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.306329 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.306488 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.306636 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.306774 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.306914 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307055 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307195 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307331 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307469 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307620 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307736 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307848 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.307963 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.308075 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.308197 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.308349 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.308486 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.308624 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.308750 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.308874 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309004 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309124 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309273 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309398 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309528 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309675 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309810 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.309959 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310112 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310241 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310354 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310472 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310609 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310736 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310858 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.310975 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.311111 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.311236 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.311377 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.311504 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.311629 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.311760 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.311885 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312020 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312146 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312280 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312412 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312541 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312668 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312811 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.312811 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313045 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313214 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313342 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313457 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313591 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313726 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313856 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.313989 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.314136 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.314264 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.314399 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.314539 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.314680 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.314825 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.314960 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.315103 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.315252 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.315400 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.315543 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.315543 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.315806 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.315959 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.316103 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.316258 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.316400 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.316543 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.316687 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.317496 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.317657 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.317784 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.317923 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.318058 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.318192 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.318327 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.318470 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.318642 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.318774 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.318893 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.319030 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.319321 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.319463 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.319602 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.319740 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.319859 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.319993 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.320112 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.320260 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.320412 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.320546 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.320690 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.320837 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.320958 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.321094 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.321261 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.321397 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.321523 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.321668 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.321815 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.321963 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.322149 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.322425 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.322726 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.322882 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.323033 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.323186 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.323323 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.323463 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.323597 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.323731 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.323870 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324019 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324160 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324299 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324433 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324565 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324690 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324822 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.324959 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.325099 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.325280 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.325418 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.325553 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.325675 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.325808 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.325962 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.326099 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.326223 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.326359 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.326497 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.326682 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.326842 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.326979 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.327100 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.327222 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.327346 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.327483 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.327642 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.327933 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.328087 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.328229 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.328369 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.328512 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.328512 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.328786 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.328928 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.329069 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.329319 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.329494 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.329640 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.329798 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.329945 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.330072 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.330196 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.330330 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.330455 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.330615 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.330752 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.330878 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331018 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331182 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331346 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331481 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331613 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331713 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331828 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.331981 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.332275 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.332412 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.332549 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.332739 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.332991 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.333133 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.333321 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.333481 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.333619 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.333764 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.333909 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.334049 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.334197 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.334332 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.334469 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.334600 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.334736 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.334862 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335002 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335145 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335283 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335419 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335574 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335574 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335826 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.335966 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.336107 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.336262 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.336399 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.336541 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.336682 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.336806 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.336925 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.337059 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.337237 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.337363 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.337486 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.337610 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.337772 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.337925 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.338065 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.338205 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.338344 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.338484 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.338636 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.338796 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.338947 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.339086 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.339225 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.339365 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.339505 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.339666 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.339804 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.339942 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.340092 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.340230 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.340366 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.340490 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.340631 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.340781 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.340932 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.341399 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.341561 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.341713 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.341856 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.341994 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.341994 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.342265 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.342422 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.342571 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.342708 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.342843 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.342981 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.343125 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.343270 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.343402 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.343538 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.343680 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.343818 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.343951 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.344075 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.344202 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.344346 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.344489 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.344639 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.344857 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.345053 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.345341 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.345535 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.345730 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.345922 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.346136 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.346366 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.346577 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.346780 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.346975 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.346975 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.347341 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.347532 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.347744 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.347744 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.348149 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.348356 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.349519 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.349709 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.349911 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.350103 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.350305 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.350497 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.350686 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.350894 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.351092 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.351499 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.351691 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.351880 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.352068 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.352292 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.352486 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.352676 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.352868 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.352868 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.353324 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.353690 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.353690 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.354081 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.354261 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.354468 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.354665 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.354872 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.355050 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.355239 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.355431 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.355638 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.355850 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.356043 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.356240 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.356446 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.356650 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.356855 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.357073 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.357299 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.357518 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.357708 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.357919 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.358124 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.358339 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.358534 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.358994 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.359186 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.359394 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.359602 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.359796 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.359992 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.360184 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.361433 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.361594 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.361771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.361928 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.362081 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.362231 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.362231 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.362495 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.362654 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.362812 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.362968 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.363097 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.363221 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.363350 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.363493 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.363625 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.363751 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.363875 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.368273 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.368467 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.368617 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.368749 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.368894 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.369036 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.369199 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.369358 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.369512 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.369653 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.369814 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.369958 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.370101 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.370256 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.370398 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.370557 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.370734 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.370877 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.371004 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.371151 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.371299 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.371437 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.371567 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.371692 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.371832 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372074 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372203 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372321 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372455 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372573 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372703 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372825 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.372948 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.373092 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.373252 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.373378 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.373526 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.373647 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.373765 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.373897 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.374022 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.374145 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.374284 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.374449 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.374449 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.374721 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.374872 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.375054 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.375221 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.375362 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.375511 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.375656 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.375810 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.375974 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.376132 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.376278 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.376439 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.376597 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.376740 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.376895 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.377038 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.377207 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.377350 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.377505 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.377638 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.377770 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.377989 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.378353 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.378513 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.378654 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.378814 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.378954 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.379094 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.379243 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.379384 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.379596 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.379753 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.379896 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.380036 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.380710 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.380856 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.381050 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.381338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.381480 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.381624 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.381767 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.381935 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.382087 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.382234 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.382234 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.382509 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.382654 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.382791 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.382791 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.383062 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.383212 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.383212 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.383447 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.383583 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.383583 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.383852 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384000 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384142 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384298 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384298 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384550 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384678 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384678 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.384934 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.385063 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.385063 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.385425 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.385553 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.385553 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.385785 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.385914 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386055 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386215 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386386 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386528 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386528 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386810 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386963 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.386963 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.387227 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.387368 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.387502 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.387655 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.387655 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.388224 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.388584 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.388745 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.388907 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.389063 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.389232 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.389380 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.389539 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.389539 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.389793 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.389948 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.390093 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.390272 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.390272 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.390599 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.390756 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.390756 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.391011 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.391011 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.391357 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.391509 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.391664 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.391807 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.391954 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.392099 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.392256 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.392403 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.392564 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.392564 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.392832 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.392974 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.393114 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.393364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.393530 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.393678 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.393829 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.393985 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.394130 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.394287 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.394430 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.394574 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.394718 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.394887 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.395033 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.395192 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.395391 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.395608 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.395803 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.396453 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.396598 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.396754 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.396900 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.397047 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.397369 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.397530 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.397675 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.397835 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.397983 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.398160 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.398361 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.398610 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.398775 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.398921 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.399070 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.399214 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.399367 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.399508 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.399674 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.399819 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.399819 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.400073 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.400244 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.400394 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.400394 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.400648 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.400648 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.400921 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.401058 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.401242 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.401378 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.401517 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.401662 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.401817 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.401971 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.402130 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.402284 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.402428 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.402428 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.402691 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.402836 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.402990 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.403133 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.403285 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.403571 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.403571 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.403862 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.403862 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404138 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404138 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404404 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404563 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404709 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404709 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404974 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.404974 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.405313 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.405492 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.405637 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.405779 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.405922 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.406070 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.406237 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.406392 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.406539 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.406717 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.406878 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.407037 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.407196 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.407341 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.407497 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.407639 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.407784 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.407938 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.408096 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.408241 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.408387 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.408602 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.408757 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.408899 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.409067 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.409316 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.409482 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.409625 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.409782 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.410043 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.410188 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.410331 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.410477 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.410618 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.410776 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.410940 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.411109 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.411251 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.411251 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.411525 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.411672 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.411672 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.411955 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.412090 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.412227 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.412227 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.412512 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.412512 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.412770 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.412770 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413048 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413218 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413387 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413535 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413679 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413823 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413964 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.413964 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.414244 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.414387 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.414530 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.414530 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.414804 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.414804 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415082 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415082 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415347 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415496 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415638 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415638 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415929 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.415929 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.416200 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.416339 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.416475 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.416634 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.416785 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.416934 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.417066 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.417254 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.417396 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.417557 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.417692 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.417842 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.417991 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.418133 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.418294 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.418450 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.418602 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.418805 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.418985 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.419134 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.419285 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.419413 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.419553 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.419694 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.419827 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.419967 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.420120 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.420262 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.420262 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.420533 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.420533 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.420821 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.420993 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.421130 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.421130 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.421475 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.421475 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.421816 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.421975 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422120 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422120 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422405 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422568 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422725 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422725 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422994 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.422994 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.423248 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.423248 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.423504 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.423504 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.423770 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.423770 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.424028 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.424181 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.424339 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.424478 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.424614 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.424746 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.424746 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.425017 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.425186 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.425324 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.425459 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.425603 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.425742 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.425903 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.426058 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.426058 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.426324 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.426324 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.426590 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.426590 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.426862 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.427029 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.427209 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.427350 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.427350 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.427350 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.427746 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.427889 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.428031 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.428173 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.428348 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.428497 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.428627 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.428741 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.428913 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429075 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429075 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429412 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429412 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429680 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429820 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.429955 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.430835 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.430954 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431068 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431068 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431310 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431310 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431551 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431551 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431800 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.431922 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.432074 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.432226 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.432365 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.432500 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.432629 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.433099 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.433099 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.433411 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.433594 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.433594 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.433847 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434006 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434006 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434283 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434431 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434431 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434687 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434850 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.434850 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435102 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435263 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435402 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435553 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435553 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435831 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435972 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.435972 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.436228 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.436479 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.436638 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.436780 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.436780 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.437051 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.437376 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.437534 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.437671 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.437671 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.437942 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438083 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.438223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.439338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.439338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.439338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.439338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.439338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.439338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.439338 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.440234 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.440428 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.441003 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.441682 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.442255 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.443346 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.443920 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.444485 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.445049 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.445645 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.446203 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.446758 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.447332 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.447890 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.448450 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.448989 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.449589 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.450164 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.450710 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.451286 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.451853 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.452402 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.452956 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.453562 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.454125 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.454750 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.455381 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.455982 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.456608 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.457201 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.457789 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.458937 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.459672 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.460075 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.460649 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.461271 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.461825 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.462387 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.462934 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.463487 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.464056 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.464620 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.465169 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.465807 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.466395 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.466942 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.467562 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.468170 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.468833 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.469787 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.470174 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.470932 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.471494 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.472062 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.472616 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.473229 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.474059 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.474640 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.475200 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.475807 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.476408 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.476993 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.477651 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.478265 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.478878 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.479441 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.480064 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.480653 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.481489 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.482031 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.482605 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:33:17.483035 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=109626) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 16:33:17.494174 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO dbcounter [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Registered counter for database nova_api May 19 16:33:17.518568 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_db.sqlalchemy.engines [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.525758 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writer thread running {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:17.588396 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.context [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b5ff4c6-24cc-4cd2-b226-22d75c194482(cell1) {{(pid=109627) load_cells /opt/stack/nova/nova/context.py:464}} May 19 16:33:17.594368 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_concurrency.lockutils [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:33:17.596012 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_concurrency.lockutils [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:33:17.596867 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_concurrency.lockutils [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:33:17.599014 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_concurrency.lockutils [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=109627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:33:17.601112 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO dbcounter [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Registered counter for database nova_cell0 May 19 16:33:17.605786 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO dbcounter [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Registered counter for database nova_cell1 May 19 16:33:17.607009 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO dbcounter [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Registered counter for database nova_api May 19 16:33:17.614410 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_db.sqlalchemy.engines [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.618129 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_db.sqlalchemy.engines [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.624117 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writer thread running {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:17.627275 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writer thread running {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:17.642950 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_db.sqlalchemy.engines [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.654447 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writer thread running {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:17.764046 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.context [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b5ff4c6-24cc-4cd2-b226-22d75c194482(cell1) {{(pid=109626) load_cells /opt/stack/nova/nova/context.py:464}} May 19 16:33:17.772128 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:33:17.774521 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:33:17.776030 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:33:17.779831 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:33:17.783865 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO dbcounter [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Registered counter for database nova_cell0 May 19 16:33:17.786591 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO dbcounter [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Registered counter for database nova_cell0 May 19 16:33:17.792294 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO dbcounter [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Registered counter for database nova_cell1 May 19 16:33:17.796915 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG oslo_db.sqlalchemy.engines [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.806405 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writer thread running {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:17.806616 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_db.sqlalchemy.engines [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.808152 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_db.sqlalchemy.engines [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.815349 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writer thread running {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:17.818636 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writer thread running {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:17.975208 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO dbcounter [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Registered counter for database nova_cell0 May 19 16:33:17.984539 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_db.sqlalchemy.engines [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=109626) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:33:17.990404 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writer thread running {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:33:18.319794 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: WARNING keystonemiddleware.auth_token [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:33:18.328399 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: WARNING keystonemiddleware.auth_token [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:33:18.351999 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: WARNING keystonemiddleware.auth_token [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:33:18.360011 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: WARNING keystonemiddleware.auth_token [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:33:18.702352 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: WARNING keystonemiddleware.auth_token [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:33:18.709870 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: WARNING keystonemiddleware.auth_token [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:33:18.715711 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562dc6b239c0 pid: 109626 (default app) May 19 16:33:18.718154 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:33:18.719379 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] 10.222.0.36 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002000 May 19 16:33:18.719577 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: WARNING keystonemiddleware.auth_token [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:33:18.720143 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 1/1] 10.222.0.36 () {50 vars in 788 bytes} [Thu May 19 16:33:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:33:18.728985 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: WARNING keystonemiddleware.auth_token [None req-14f5d6e2-8b95-4ab9-8b18-0489eec21c0a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:33:18.734599 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x562dc6b239c0 pid: 109627 (default app) May 19 16:34:52.629740 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:34:52.631689 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002757 May 19 16:34:52.632768 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 2/2] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:34:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:34:52.663107 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writing DB stats nova_api:SELECT=3 {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:52.664718 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writing DB stats nova_cell0:SELECT=3 {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:52.666364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writing DB stats nova_cell1:SELECT=3 {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:52.667638 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:53.220629 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-61268304-07de-43c9-94b3-13f25c3453b2 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:34:53.259071 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-61268304-07de-43c9-94b3-13f25c3453b2 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.615123 May 19 16:34:53.260411 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 1/3] 10.222.0.36 () {60 vars in 1291 bytes} [Thu May 19 16:34:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:34:56.565112 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:34:56.567479 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-d47fe08f-fc51-4386-b78a-d74616f37bcb None None] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003071 May 19 16:34:56.568297 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 3/4] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:34:56 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:34:56.682608 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-70ba6cb1-ee67-4d48-b5c5-62f182423ae6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "ram": 256, "os-flavor-access:is_public": true, "name": "cirros256", "id": "c1"}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:34:56.719294 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:34:56.719294 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: warnings.warn(msg) May 19 16:34:56.773496 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-70ba6cb1-ee67-4d48-b5c5-62f182423ae6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.193875 May 19 16:34:56.774697 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 2/5] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:34:56 2022] POST /compute/v2.1/flavors => generated 407 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:34:56.798708 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_api:SELECT=3 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:56.800693 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_cell1:SELECT=3 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:56.802700 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_cell0:SELECT=3 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:56.803960 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_cell0:SELECT=3 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:34:57.229772 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-a65d5436-4b31-4585-99ef-2bc5dd678539 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:34:57.234605 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:34:57.234605 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: warnings.warn(msg) May 19 16:34:57.364881 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-a65d5436-4b31-4585-99ef-2bc5dd678539 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.575720 May 19 16:34:57.376023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 4/6] 10.222.0.36 () {64 vars in 1335 bytes} [Thu May 19 16:34:56 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:35:00.898273 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-70ba6cb1-ee67-4d48-b5c5-62f182423ae6 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:00.900096 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-70ba6cb1-ee67-4d48-b5c5-62f182423ae6 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002548 May 19 16:35:00.900857 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 3/7] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:00 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:01.067753 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-8ee29177-05e0-474e-9e9e-2d58d1ec8e63 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1", "rxtx_factor": 1.0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "swap": 0, "disk": 5}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:01.088591 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:35:01.088591 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: warnings.warn(msg) May 19 16:35:01.115559 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-8ee29177-05e0-474e-9e9e-2d58d1ec8e63 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.204294 May 19 16:35:01.116967 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 5/8] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:00 2022] POST /compute/v2.1/flavors => generated 404 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:35:01.131873 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-82e28d80-979b-48c9-ae12-0f9813cac658 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:01.134349 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:35:01.134349 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: warnings.warn(msg) May 19 16:35:01.182541 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-82e28d80-979b-48c9-ae12-0f9813cac658 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055620 May 19 16:35:01.184580 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 4/9] 10.222.0.36 () {64 vars in 1335 bytes} [Thu May 19 16:35:01 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:35:04.385239 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-8ee29177-05e0-474e-9e9e-2d58d1ec8e63 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:04.386437 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-8ee29177-05e0-474e-9e9e-2d58d1ec8e63 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 May 19 16:35:04.389527 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 6/10] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:04 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:35:04.474291 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-e9c1a880-4811-49b3-9cfb-609c80830121 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "id": "d2", "vcpus": 1, "disk": 10}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:04.495181 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-e9c1a880-4811-49b3-9cfb-609c80830121 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.101772 May 19 16:35:04.495857 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 5/11] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:04 2022] POST /compute/v2.1/flavors => generated 404 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:35:04.508226 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-b5b01983-0501-4890-be81-ebdab95d09b8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:04.541172 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-b5b01983-0501-4890-be81-ebdab95d09b8 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036482 May 19 16:35:04.542336 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 7/12] 10.222.0.36 () {64 vars in 1335 bytes} [Thu May 19 16:35:04 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:35:07.149144 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-e9c1a880-4811-49b3-9cfb-609c80830121 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:07.150858 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-e9c1a880-4811-49b3-9cfb-609c80830121 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002585 May 19 16:35:07.151585 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 6/13] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:07 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:07.230526 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-b6740ea6-d71c-4f51-a3d1-61d7ed58b6a6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 10, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "ds2G", "id": "d3"}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:07.260709 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-b6740ea6-d71c-4f51-a3d1-61d7ed58b6a6 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.102071 May 19 16:35:07.261990 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 8/14] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:07 2022] POST /compute/v2.1/flavors => generated 404 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 16:35:07.275883 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-41a7b39b-ae03-437f-8a33-7689fbce3d43 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:07.330274 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-41a7b39b-ae03-437f-8a33-7689fbce3d43 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.057835 May 19 16:35:07.332650 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 7/15] 10.222.0.36 () {64 vars in 1335 bytes} [Thu May 19 16:35:07 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:35:10.218364 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-b6740ea6-d71c-4f51-a3d1-61d7ed58b6a6 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:10.220909 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-b6740ea6-d71c-4f51-a3d1-61d7ed58b6a6 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002602 May 19 16:35:10.221706 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 9/16] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:10.293890 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-d9d33e74-39aa-4a65-b1fc-632b78cb2411 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "rxtx_factor": 1.0}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:10.320947 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-d9d33e74-39aa-4a65-b1fc-632b78cb2411 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.088943 May 19 16:35:10.321878 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 8/17] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:10 2022] POST /compute/v2.1/flavors => generated 404 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:35:10.341632 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-95eb618d-a652-4d02-a4b3-20d458710fa4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:10.391435 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-95eb618d-a652-4d02-a4b3-20d458710fa4 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.056060 May 19 16:35:10.393590 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 10/18] 10.222.0.36 () {64 vars in 1335 bytes} [Thu May 19 16:35:10 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:35:12.812988 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-d9d33e74-39aa-4a65-b1fc-632b78cb2411 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:12.814895 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-d9d33e74-39aa-4a65-b1fc-632b78cb2411 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002611 May 19 16:35:12.815673 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 9/19] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:12 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:12.906423 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-af6a1395-ce19-40bb-9af5-4619c42290d4 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:12.933368 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-af6a1395-ce19-40bb-9af5-4619c42290d4 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.107594 May 19 16:35:12.934691 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 11/20] 10.222.0.36 () {60 vars in 1291 bytes} [Thu May 19 16:35:12 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:35:15.835540 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-d9d33e74-39aa-4a65-b1fc-632b78cb2411 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:15.837379 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-d9d33e74-39aa-4a65-b1fc-632b78cb2411 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002471 May 19 16:35:15.838209 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 10/21] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:15 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:15.935836 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-2a3728bb-2514-44f8-b874-809ab18e3953 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "1", "name": "m1.tiny", "ram": 512, "vcpus": 1, "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:15.962967 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-2a3728bb-2514-44f8-b874-809ab18e3953 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.114562 May 19 16:35:15.963537 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 12/22] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:15 2022] POST /compute/v2.1/flavors => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:35:15.976082 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-205182f1-2446-4cf3-9d70-fbe7b4a40436 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:16.010852 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-205182f1-2446-4cf3-9d70-fbe7b4a40436 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038168 May 19 16:35:16.011994 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 11/23] 10.222.0.36 () {64 vars in 1332 bytes} [Thu May 19 16:35:15 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:35:18.705836 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-2a3728bb-2514-44f8-b874-809ab18e3953 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:18.707532 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-2a3728bb-2514-44f8-b874-809ab18e3953 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002218 May 19 16:35:18.708154 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 13/24] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:18.818421 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-2a1d9fcf-b923-4424-be61-20aa11972e58 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "ram": 2048, "vcpus": 1, "name": "m1.small", "id": "2", "os-flavor-access:is_public": true, "swap": 0}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:18.842386 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-2a1d9fcf-b923-4424-be61-20aa11972e58 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.126097 May 19 16:35:18.842974 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 12/25] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:18 2022] POST /compute/v2.1/flavors => generated 405 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 16:35:18.855943 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-6ce5c866-71bf-434e-8de9-fba37ebe6733 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:18.885289 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-6ce5c866-71bf-434e-8de9-fba37ebe6733 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033035 May 19 16:35:18.885913 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 14/26] 10.222.0.36 () {64 vars in 1332 bytes} [Thu May 19 16:35:18 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:35:21.407888 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-2a1d9fcf-b923-4424-be61-20aa11972e58 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:21.409404 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-2a1d9fcf-b923-4424-be61-20aa11972e58 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002127 May 19 16:35:21.410551 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 13/27] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:21 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:35:21.497855 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-19a4f268-603a-4ee3-ab33-76ffc6b4e710 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "rxtx_factor": 1.0, "name": "m1.medium", "id": "3", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "disk": 40}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:21.528362 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-19a4f268-603a-4ee3-ab33-76ffc6b4e710 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.109980 May 19 16:35:21.529078 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 15/28] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:21 2022] POST /compute/v2.1/flavors => generated 406 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 16:35:21.542527 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-64a49cf2-ead7-434e-bc60-8943f02f9466 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:21.573278 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-64a49cf2-ead7-434e-bc60-8943f02f9466 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.034577 May 19 16:35:21.574093 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 14/29] 10.222.0.36 () {64 vars in 1332 bytes} [Thu May 19 16:35:21 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:35:24.449575 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-19a4f268-603a-4ee3-ab33-76ffc6b4e710 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:24.451341 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-19a4f268-603a-4ee3-ab33-76ffc6b4e710 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002513 May 19 16:35:24.452440 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 16/30] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:24 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:24.558705 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-3461999f-b6be-4ab2-82a3-e4a85b08ec0c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "4", "ram": 8192, "name": "m1.large", "swap": 0, "vcpus": 4}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:24.571500 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:24.595850 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-3461999f-b6be-4ab2-82a3-e4a85b08ec0c admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.136396 May 19 16:35:24.596513 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 15/31] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:24 2022] POST /compute/v2.1/flavors => generated 405 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:35:24.613836 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-235dba20-7bfc-491b-8bca-489246d00da3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:24.651476 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-235dba20-7bfc-491b-8bca-489246d00da3 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.044565 May 19 16:35:24.664479 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 17/32] 10.222.0.36 () {64 vars in 1332 bytes} [Thu May 19 16:35:24 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:35:27.556519 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-3461999f-b6be-4ab2-82a3-e4a85b08ec0c admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:27.558279 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-3461999f-b6be-4ab2-82a3-e4a85b08ec0c admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002229 May 19 16:35:27.558916 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 16/33] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:27 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:27.634521 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-7c98cfed-196f-4302-9c46-91c668c2faaf admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "name": "m1.xlarge", "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "vcpus": 8}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:27.642415 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:27.655542 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-7c98cfed-196f-4302-9c46-91c668c2faaf admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.089656 May 19 16:35:27.664223 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 18/34] 10.222.0.36 () {64 vars in 1282 bytes} [Thu May 19 16:35:27 2022] POST /compute/v2.1/flavors => generated 408 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 16:35:27.673844 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-753c3c1c-64a0-48a8-b434-30e8004362e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:27.701511 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-753c3c1c-64a0-48a8-b434-30e8004362e0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032318 May 19 16:35:27.709872 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 17/35] 10.222.0.36 () {64 vars in 1332 bytes} [Thu May 19 16:35:27 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:35:52.084650 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-7c98cfed-196f-4302-9c46-91c668c2faaf admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:52.085713 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-7c98cfed-196f-4302-9c46-91c668c2faaf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001503 May 19 16:35:52.086118 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 19/36] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:35:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:52.097567 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:35:52.157818 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-c1125a41-2758-45fd-92cb-6918b1d16227 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:52.191235 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-c1125a41-2758-45fd-92cb-6918b1d16227 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.097321 May 19 16:35:52.192200 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 18/37] 10.222.0.36 () {60 vars in 1291 bytes} [Thu May 19 16:35:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:35:53.345269 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-7c98cfed-196f-4302-9c46-91c668c2faaf admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:53.346858 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-7c98cfed-196f-4302-9c46-91c668c2faaf admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 May 19 16:35:53.347421 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 20/38] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:35:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:53.577886 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9e83f79b-78f1-48f1-abea-f6f123f63866 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:53.584229 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.wsgi [None req-9e83f79b-78f1-48f1-abea-f6f123f63866 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9e83f79b-78f1-48f1-abea-f6f123f63866 admin admin] Request method failure captured: May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Accept: application/json May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Accept-Encoding: gzip, deflate May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Connection: keep-alive May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Content-Length: 0 May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Host: 10.222.0.36 May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Openstack-Api-Version: compute 2.90 May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Openstack-System-Scope: None May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: User-Agent: python-novaclient May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Auth-Token: gAAAAABihnHpVA_m4zMdOBhg8LUbjBxTRXCBYXwvJbHLsbtaLpafR6cg4a7e7bqdzMvEHVX8Zhv4MLyAv27XnA3-8O1fYGVwJ35cJp_fGN1eS08W-I9i4YL2AmoeIb9Q8HVKR98eKC3ji1jEbb0i69W8W4eiinV6jXuOKZYwyan0CKRHlJYA5Yo May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Domain-Id: None May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Domain-Name: None May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Identity-Status: Confirmed May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Is-Admin-Project: True May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Openstack-Nova-Api-Version: 2.90 May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Domain-Id: default May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Domain-Name: Default May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Name: admin May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Role: reader,admin,member May 19 16:35:53.587637 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Roles: reader,admin,member May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d5de9b2c50341a8b78fb369c7765787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant: admin May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant-Name: admin May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User: admin May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Domain-Id: default May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Domain-Name: Default May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Id: ac4bfc4d6198473c8d280a14b2c6036f May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Name: admin May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: method: > May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: exception: Flavor 42 could not be found. May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: action_args: {'id': '42'} May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:35:53.590364 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:53.592317 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:53.595158 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9e83f79b-78f1-48f1-abea-f6f123f63866 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:35:53.599742 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-9e83f79b-78f1-48f1-abea-f6f123f63866 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.072402 May 19 16:35:53.599742 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 19/39] 10.222.0.36 () {60 vars in 1190 bytes} [Thu May 19 16:35:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 16:35:53.604391 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-f4d3a8d9-250c-4dca-a4dd-33eb8acdf005 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:53.630498 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-f4d3a8d9-250c-4dca-a4dd-33eb8acdf005 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.030423 May 19 16:35:53.631096 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 21/40] 10.222.0.36 () {60 vars in 1210 bytes} [Thu May 19 16:35:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:35:53.649192 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-efc8e490-45ae-40d9-b419-75a830e59f35 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:53.680075 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-efc8e490-45ae-40d9-b419-75a830e59f35 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.034602 May 19 16:35:53.681866 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 20/41] 10.222.0.36 () {60 vars in 1210 bytes} [Thu May 19 16:35:53 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:35:53.693588 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-1b181598-8e87-4ba5-8b1e-a69da6e0914d admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:53.700319 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.wsgi [None req-1b181598-8e87-4ba5-8b1e-a69da6e0914d admin admin] HTTP exception thrown: Flavor 42 could not be found. May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-1b181598-8e87-4ba5-8b1e-a69da6e0914d admin admin] Request method failure captured: May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Accept: application/json May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Accept-Encoding: gzip, deflate May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Connection: keep-alive May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Content-Length: 0 May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Host: 10.222.0.36 May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Openstack-Api-Version: compute 2.90 May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Openstack-System-Scope: None May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: User-Agent: python-novaclient May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Auth-Token: gAAAAABihnHpVA_m4zMdOBhg8LUbjBxTRXCBYXwvJbHLsbtaLpafR6cg4a7e7bqdzMvEHVX8Zhv4MLyAv27XnA3-8O1fYGVwJ35cJp_fGN1eS08W-I9i4YL2AmoeIb9Q8HVKR98eKC3ji1jEbb0i69W8W4eiinV6jXuOKZYwyan0CKRHlJYA5Yo May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Domain-Id: None May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Domain-Name: None May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Identity-Status: Confirmed May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Is-Admin-Project: True May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Openstack-Nova-Api-Version: 2.90 May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Domain-Id: default May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Domain-Name: Default May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Name: admin May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Role: reader,admin,member May 19 16:35:53.703771 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Roles: reader,admin,member May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d5de9b2c50341a8b78fb369c7765787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant: admin May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant-Name: admin May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User: admin May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Domain-Id: default May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Domain-Name: Default May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Id: ac4bfc4d6198473c8d280a14b2c6036f May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Name: admin May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: method: > May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: exception: Flavor 42 could not be found. May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: action_args: {'id': '42'} May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:35:53.706098 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:53.708167 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:53.710155 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-1b181598-8e87-4ba5-8b1e-a69da6e0914d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=109626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:35:53.712242 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-1b181598-8e87-4ba5-8b1e-a69da6e0914d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.016534 May 19 16:35:53.712242 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 22/42] 10.222.0.36 () {60 vars in 1190 bytes} [Thu May 19 16:35:53 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 19 16:35:54.656141 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-efc8e490-45ae-40d9-b419-75a830e59f35 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:54.658062 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-efc8e490-45ae-40d9-b419-75a830e59f35 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001972 May 19 16:35:54.658741 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 21/43] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:35:54 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:54.869261 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-49f2bdb5-52b6-4ff4-b2c6-75f0cd5cf4d6 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:54.877557 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.wsgi [None req-49f2bdb5-52b6-4ff4-b2c6-75f0cd5cf4d6 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-49f2bdb5-52b6-4ff4-b2c6-75f0cd5cf4d6 admin admin] Request method failure captured: May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Accept: application/json May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Accept-Encoding: gzip, deflate May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Connection: keep-alive May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Content-Length: 0 May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Host: 10.222.0.36 May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Openstack-Api-Version: compute 2.90 May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Openstack-System-Scope: None May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: User-Agent: python-novaclient May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Auth-Token: gAAAAABihnHqCqiesszrlDRJ4bUCyXWww4qs5bldBDNy-O2MxYWqP2ZdzEDd2bUeLe4XUcwwEupNKiV6gfuYkAMTETLRM-YHPcpFV56eRxAQMUJeqE-c0h6pEawWM2NYgAnnnzGo3I6a4SQYdPKDXIdx1zx1u26_pxQve625h2-PuwOZzK7idkM May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Domain-Id: None May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Domain-Name: None May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Identity-Status: Confirmed May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Is-Admin-Project: True May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Openstack-Nova-Api-Version: 2.90 May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Domain-Id: default May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Domain-Name: Default May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Name: admin May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Role: reader,admin,member May 19 16:35:54.879571 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Roles: reader,admin,member May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d5de9b2c50341a8b78fb369c7765787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant: admin May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant-Name: admin May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User: admin May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Domain-Id: default May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Domain-Name: Default May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Id: ac4bfc4d6198473c8d280a14b2c6036f May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Name: admin May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: method: > May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: exception: Flavor 84 could not be found. May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: action_args: {'id': '84'} May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:35:54.882023 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:54.883774 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:54.886175 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-49f2bdb5-52b6-4ff4-b2c6-75f0cd5cf4d6 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:35:54.888782 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-49f2bdb5-52b6-4ff4-b2c6-75f0cd5cf4d6 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.079479 May 19 16:35:54.888782 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 23/44] 10.222.0.36 () {60 vars in 1190 bytes} [Thu May 19 16:35:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 16:35:54.899415 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-0f7f5805-363c-4832-abd9-f528847ef819 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:54.926916 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-0f7f5805-363c-4832-abd9-f528847ef819 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035283 May 19 16:35:54.928028 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 22/45] 10.222.0.36 () {60 vars in 1210 bytes} [Thu May 19 16:35:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:35:54.945423 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-cca282bb-55bb-469a-a6db-4439cb977ccd admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:54.973950 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-cca282bb-55bb-469a-a6db-4439cb977ccd admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.035450 May 19 16:35:54.974980 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 24/46] 10.222.0.36 () {60 vars in 1210 bytes} [Thu May 19 16:35:54 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:35:54.988948 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-86fe939a-f703-401a-903a-4d09c6c9c399 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:54.995108 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.wsgi [None req-86fe939a-f703-401a-903a-4d09c6c9c399 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-86fe939a-f703-401a-903a-4d09c6c9c399 admin admin] Request method failure captured: May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Accept: application/json May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Accept-Encoding: gzip, deflate May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Connection: keep-alive May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Content-Length: 0 May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Host: 10.222.0.36 May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Openstack-Api-Version: compute 2.90 May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Openstack-System-Scope: None May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: User-Agent: python-novaclient May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Auth-Token: gAAAAABihnHqCqiesszrlDRJ4bUCyXWww4qs5bldBDNy-O2MxYWqP2ZdzEDd2bUeLe4XUcwwEupNKiV6gfuYkAMTETLRM-YHPcpFV56eRxAQMUJeqE-c0h6pEawWM2NYgAnnnzGo3I6a4SQYdPKDXIdx1zx1u26_pxQve625h2-PuwOZzK7idkM May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Domain-Id: None May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Domain-Name: None May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Identity-Status: Confirmed May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Is-Admin-Project: True May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Openstack-Nova-Api-Version: 2.90 May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Domain-Id: default May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Domain-Name: Default May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Name: admin May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Role: reader,admin,member May 19 16:35:54.996704 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Roles: reader,admin,member May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d5de9b2c50341a8b78fb369c7765787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant: admin May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant-Name: admin May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User: admin May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Domain-Id: default May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Domain-Name: Default May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Id: ac4bfc4d6198473c8d280a14b2c6036f May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Name: admin May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: method: > May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: exception: Flavor 84 could not be found. May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: action_args: {'id': '84'} May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:35:54.999175 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:55.000807 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:55.002946 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-86fe939a-f703-401a-903a-4d09c6c9c399 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=109627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:35:55.005491 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-86fe939a-f703-401a-903a-4d09c6c9c399 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013089 May 19 16:35:55.005491 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 23/47] 10.222.0.36 () {60 vars in 1190 bytes} [Thu May 19 16:35:54 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 16:35:56.155301 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-cca282bb-55bb-469a-a6db-4439cb977ccd admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:56.156823 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-cca282bb-55bb-469a-a6db-4439cb977ccd admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002004 May 19 16:35:56.157486 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 25/48] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:35:56 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:56.356254 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-f30de2cc-17f4-4904-814d-643391546ccc admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:56.364618 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.wsgi [None req-f30de2cc-17f4-4904-814d-643391546ccc admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-f30de2cc-17f4-4904-814d-643391546ccc admin admin] Request method failure captured: May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Accept: application/json May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Accept-Encoding: gzip, deflate May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Connection: keep-alive May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Content-Length: 0 May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Host: 10.222.0.36 May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Openstack-Api-Version: compute 2.90 May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Openstack-System-Scope: None May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: User-Agent: python-novaclient May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Auth-Token: gAAAAABihnHsCg2hcJzp_i7qGCw9LUmrrmmqdCZq7GbfwPY8gK3UQwQXkYJAK8VewtKLyOXl6K-BUTDVrYCWKZy-jB9dbZ_5Be8XIHnv1uLX7WAKFoue-be98ljORG62iA-1RKb_VjEXm-m4QX_6y-qocRRK0tAIgpX0aNGJCiGtNIjtBC4CzbE May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Domain-Id: None May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Domain-Name: None May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Identity-Status: Confirmed May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Is-Admin-Project: True May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Openstack-Nova-Api-Version: 2.90 May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Domain-Id: default May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Domain-Name: Default May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Project-Name: admin May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Role: reader,admin,member May 19 16:35:56.366227 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Roles: reader,admin,member May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d5de9b2c50341a8b78fb369c7765787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant: admin May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-Tenant-Name: admin May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User: admin May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Domain-Id: default May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Domain-Name: Default May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Id: ac4bfc4d6198473c8d280a14b2c6036f May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: X-User-Name: admin May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: method: > May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: exception: Flavor 451 could not be found. May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: action_args: {'id': '451'} May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:35:56.368859 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:56.370582 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: ERROR nova.api.openstack.wsgi May 19 16:35:56.372635 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-f30de2cc-17f4-4904-814d-643391546ccc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:35:56.374986 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-f30de2cc-17f4-4904-814d-643391546ccc admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.068719 May 19 16:35:56.374986 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 24/49] 10.222.0.36 () {60 vars in 1193 bytes} [Thu May 19 16:35:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 16:35:56.379695 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-01ad6f6f-6c5f-4e65-9053-969181e6d0b3 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:56.394142 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-01ad6f6f-6c5f-4e65-9053-969181e6d0b3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019287 May 19 16:35:56.394716 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 26/50] 10.222.0.36 () {60 vars in 1210 bytes} [Thu May 19 16:35:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:35:56.407074 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:56.422781 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.020780 May 19 16:35:56.423361 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 25/51] 10.222.0.36 () {60 vars in 1210 bytes} [Thu May 19 16:35:56 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:35:56.433521 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-ccab9ee3-a4b8-4fd5-8414-0325f218ff88 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:56.439141 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.wsgi [None req-ccab9ee3-a4b8-4fd5-8414-0325f218ff88 admin admin] HTTP exception thrown: Flavor 451 could not be found. May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-ccab9ee3-a4b8-4fd5-8414-0325f218ff88 admin admin] Request method failure captured: May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Accept: application/json May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Accept-Encoding: gzip, deflate May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Connection: keep-alive May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Content-Length: 0 May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Host: 10.222.0.36 May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Openstack-Api-Version: compute 2.90 May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Openstack-System-Scope: None May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: User-Agent: python-novaclient May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Auth-Token: gAAAAABihnHsCg2hcJzp_i7qGCw9LUmrrmmqdCZq7GbfwPY8gK3UQwQXkYJAK8VewtKLyOXl6K-BUTDVrYCWKZy-jB9dbZ_5Be8XIHnv1uLX7WAKFoue-be98ljORG62iA-1RKb_VjEXm-m4QX_6y-qocRRK0tAIgpX0aNGJCiGtNIjtBC4CzbE May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Domain-Id: None May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Domain-Name: None May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Identity-Status: Confirmed May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Is-Admin-Project: True May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Openstack-Nova-Api-Version: 2.90 May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Domain-Id: default May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Domain-Name: Default May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Project-Name: admin May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Role: reader,admin,member May 19 16:35:56.441470 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Roles: reader,admin,member May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d5de9b2c50341a8b78fb369c7765787", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d5de9b2c50341a8b78fb369c7765787"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant: admin May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant-Id: 8d5de9b2c50341a8b78fb369c7765787 May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-Tenant-Name: admin May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User: admin May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Domain-Id: default May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Domain-Name: Default May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Id: ac4bfc4d6198473c8d280a14b2c6036f May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: X-User-Name: admin May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: method: > May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: exception: Flavor 451 could not be found. May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: action_args: {'id': '451'} May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:35:56.444215 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:56.445940 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: ERROR nova.api.openstack.wsgi May 19 16:35:56.448678 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-ccab9ee3-a4b8-4fd5-8414-0325f218ff88 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=109626) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:35:56.450777 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-ccab9ee3-a4b8-4fd5-8414-0325f218ff88 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012975 May 19 16:35:56.450777 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 27/52] 10.222.0.36 () {60 vars in 1193 bytes} [Thu May 19 16:35:56 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 19 16:35:57.443115 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:57.444130 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 19 16:35:57.444559 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 26/53] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:35:57 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:35:57.648395 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-2e130cde-d2e4-4e84-af8e-668fd0dc32b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:57.675170 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-2e130cde-d2e4-4e84-af8e-668fd0dc32b0 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.091818 May 19 16:35:57.675745 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 28/54] 10.222.0.36 () {64 vars in 1235 bytes} [Thu May 19 16:35:57 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:35:58.580332 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:58.582038 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 19 16:35:58.582436 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 27/55] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:35:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:58.773300 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-8e7cc536-7f28-4fec-bd5f-90e6395691bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:58.791653 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-8e7cc536-7f28-4fec-bd5f-90e6395691bb admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.070804 May 19 16:35:58.792189 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 29/56] 10.222.0.36 () {64 vars in 1235 bytes} [Thu May 19 16:35:58 2022] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:35:59.718793 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:35:59.720063 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001818 May 19 16:35:59.720466 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 28/57] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:35:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:35:59.913702 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-a562adce-d9d1-403f-a2db-0e9542b9c8a9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:35:59.933963 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-a562adce-d9d1-403f-a2db-0e9542b9c8a9 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.076536 May 19 16:35:59.934456 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 30/58] 10.222.0.36 () {64 vars in 1235 bytes} [Thu May 19 16:35:59 2022] POST /compute/v2.1/flavors => generated 407 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:36:00.824390 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:36:00.825431 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001497 May 19 16:36:00.825846 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 29/59] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:36:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:36:01.019738 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-e40b2799-416a-4bfb-a678-f4bb11d9a221 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:36:01.039194 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-e40b2799-416a-4bfb-a678-f4bb11d9a221 admin admin] 10.222.0.36 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.073561 May 19 16:36:01.039660 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 31/60] 10.222.0.36 () {64 vars in 1235 bytes} [Thu May 19 16:36:00 2022] POST /compute/v2.1/flavors => generated 409 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:36:01.970554 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:36:01.971564 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001480 May 19 16:36:01.972035 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 30/61] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:36:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:36:02.165315 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-5b9b4710-8567-4faa-9a5d-068934a9000e admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:36:02.185125 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-5b9b4710-8567-4faa-9a5d-068934a9000e admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073804 May 19 16:36:02.185703 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 32/62] 10.222.0.36 () {60 vars in 1202 bytes} [Thu May 19 16:36:02 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:37:06.422566 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:37:06.423554 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-1cbd7352-181f-41dd-a96a-20b5b404c03d admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 May 19 16:37:06.423949 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 31/63] 10.222.0.36 () {54 vars in 930 bytes} [Thu May 19 16:37:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:37:06.431406 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:06.501197 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-50ab49fc-e989-4422-b68a-952d20a8f240 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:37:06.521720 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-50ab49fc-e989-4422-b68a-952d20a8f240 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.091784 May 19 16:37:06.522269 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 33/64] 10.222.0.36 () {60 vars in 1291 bytes} [Thu May 19 16:37:06 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:37:06.541433 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG dbcounter [-] [109627] Writing DB stats nova_api:SELECT=14 {{(pid=109627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:37:06.545057 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-b2153f1c-ba1f-4cb2-beff-f927822bf09d admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:37:06.552900 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-b2153f1c-ba1f-4cb2-beff-f927822bf09d admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012869 May 19 16:37:06.553485 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 32/65] 10.222.0.36 () {60 vars in 1282 bytes} [Thu May 19 16:37:06 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:37:06.565772 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-f473518e-e620-407f-9b8c-8c4acaba3e8b admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:37:06.573660 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-f473518e-e620-407f-9b8c-8c4acaba3e8b admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011922 May 19 16:37:06.574202 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 34/66] 10.222.0.36 () {60 vars in 1285 bytes} [Thu May 19 16:37:06 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:37:06.586208 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:37:06.593926 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011356 May 19 16:37:06.594461 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 33/67] 10.222.0.36 () {60 vars in 1285 bytes} [Thu May 19 16:37:06 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:37:06.605836 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-f2ffc95d-b500-4efd-a1e3-962c4b495641 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:37:06.614271 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-f2ffc95d-b500-4efd-a1e3-962c4b495641 admin admin] 10.222.0.36 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011893 May 19 16:37:06.614738 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 35/68] 10.222.0.36 () {60 vars in 1282 bytes} [Thu May 19 16:37:06 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:40:58.481230 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:40:58.482248 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 May 19 16:40:58.482643 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 34/69] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:40:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:40:58.643008 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_api:SELECT=6 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:40:58.754672 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-b453e4c5-5bc0-4625-bf00-c430f39a61a0 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:40:58.755819 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:40:58.755819 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: warnings.warn(msg) May 19 16:40:58.757014 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-b453e4c5-5bc0-4625-bf00-c430f39a61a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:40:58.757494 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-b453e4c5-5bc0-4625-bf00-c430f39a61a0 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:40:58.758276 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-b453e4c5-5bc0-4625-bf00-c430f39a61a0 admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:40:58.758699 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-b453e4c5-5bc0-4625-bf00-c430f39a61a0 admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:40:58.792972 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-b453e4c5-5bc0-4625-bf00-c430f39a61a0 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.154775 May 19 16:40:58.793567 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 36/70] 10.222.0.36 () {60 vars in 1193 bytes} [Thu May 19 16:40:58 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:40:59.700082 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:40:59.701092 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 19 16:40:59.701548 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 35/71] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:40:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:40:59.889998 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-f2ad025b-8e44-4cb1-8238-cde56bab2c9b admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:40:59.891249 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:40:59.891249 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: warnings.warn(msg) May 19 16:40:59.892795 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-f2ad025b-8e44-4cb1-8238-cde56bab2c9b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:40:59.892892 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-f2ad025b-8e44-4cb1-8238-cde56bab2c9b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:40:59.893689 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-f2ad025b-8e44-4cb1-8238-cde56bab2c9b admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:40:59.894110 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-f2ad025b-8e44-4cb1-8238-cde56bab2c9b admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:40:59.914061 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-f2ad025b-8e44-4cb1-8238-cde56bab2c9b admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.075123 May 19 16:40:59.914549 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 37/72] 10.222.0.36 () {60 vars in 1193 bytes} [Thu May 19 16:40:59 2022] GET /compute/v2.1/os-services => generated 791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:41:11.241599 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:41:11.242597 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 May 19 16:41:11.242986 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 36/73] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:41:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:41:11.383722 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_cell0:SELECT=4 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:41:11.384701 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_cell1:SELECT=4 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:41:11.385316 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG dbcounter [-] [109626] Writing DB stats nova_api:SELECT=8 {{(pid=109626) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:41:11.434953 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-fd95ae83-03ba-4b82-a015-7f00db68db83 admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:41:11.436101 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:41:11.436101 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: warnings.warn(msg) May 19 16:41:11.437297 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-fd95ae83-03ba-4b82-a015-7f00db68db83 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:41:11.437731 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-fd95ae83-03ba-4b82-a015-7f00db68db83 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:41:11.438495 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-fd95ae83-03ba-4b82-a015-7f00db68db83 admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:41:11.438913 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-fd95ae83-03ba-4b82-a015-7f00db68db83 admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:41:11.462951 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-fd95ae83-03ba-4b82-a015-7f00db68db83 admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083466 May 19 16:41:11.463432 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 38/74] 10.222.0.36 () {60 vars in 1193 bytes} [Thu May 19 16:41:11 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:41:12.374269 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: DEBUG nova.api.openstack.wsgi [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] Calling method '>' {{(pid=109627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:41:12.375281 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: INFO nova.api.openstack.requestlog [None req-9d98bba7-d4dd-40e0-a197-810a23efe4f3 admin admin] 10.222.0.36 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001413 May 19 16:41:12.375679 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: [pid: 109627|app: 0|req: 37/75] 10.222.0.36 () {56 vars in 1074 bytes} [Thu May 19 16:41:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:41:12.566698 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG nova.api.openstack.wsgi [None req-bfc5fa1e-a456-4690-a326-a59de2c9ad6c admin admin] Calling method '>' {{(pid=109626) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:41:12.567881 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 19 16:41:12.567881 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: warnings.warn(msg) May 19 16:41:12.569050 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-bfc5fa1e-a456-4690-a326-a59de2c9ad6c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:41:12.569513 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-bfc5fa1e-a456-4690-a326-a59de2c9ad6c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:41:12.570321 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-bfc5fa1e-a456-4690-a326-a59de2c9ad6c admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:41:12.570741 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: DEBUG oslo_concurrency.lockutils [None req-bfc5fa1e-a456-4690-a326-a59de2c9ad6c admin admin] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=109626) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:41:12.592481 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: INFO nova.api.openstack.requestlog [None req-bfc5fa1e-a456-4690-a326-a59de2c9ad6c admin admin] 10.222.0.36 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.077552 May 19 16:41:12.593027 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: [pid: 109626|app: 0|req: 39/76] 10.222.0.36 () {60 vars in 1193 bytes} [Thu May 19 16:41:12 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:42:09.636956 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: Thu May 19 16:42:09 2022 - graceful shutdown triggered... May 19 16:42:09.638721 dv-cinder-842433-1-iscsi devstack@n-api.service[109626]: Gracefully killing worker 1 (pid: 109626)... May 19 16:42:09.639714 dv-cinder-842433-1-iscsi devstack@n-api.service[109627]: Gracefully killing worker 2 (pid: 109627)... May 19 16:42:09.640197 dv-cinder-842433-1-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 19 16:42:10.637867 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: worker 1 buried after 1 seconds May 19 16:42:10.637867 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: worker 2 buried after 1 seconds May 19 16:42:10.637867 dv-cinder-842433-1-iscsi devstack@n-api.service[109625]: goodbye to uWSGI. May 19 16:42:10.639518 dv-cinder-842433-1-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 19 16:42:10.640269 dv-cinder-842433-1-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 19 16:42:10.643159 dv-cinder-842433-1-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 19 16:42:10.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 19 16:42:10 2022] *** May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: nodename: dv-cinder-842433-1-iscsi May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: machine: x86_64 May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: clock source: unix May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: pcre jit disabled May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: detected number of CPU cores: 4 May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: current working directory: / May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: detected binary path: /usr/bin/uwsgi-core May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: your processes number limit is 47680 May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: your memory page size is 4096 bytes May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: detected max file descriptor number: 2048 May 19 16:42:10.704658 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: lock engine: pthread robust mutexes May 19 16:42:10.706357 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: thunder lock: enabled May 19 16:42:10.706357 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 19 16:42:10.706357 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 19 16:42:10.751665 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: Python main interpreter initialized at 0x564c72c129c0 May 19 16:42:10.751665 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: python threads support enabled May 19 16:42:10.751665 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: your server socket listen backlog is limited to 100 connections May 19 16:42:10.751665 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: your mercy for graceful operations on workers is 90 seconds May 19 16:42:10.752363 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: mapped 403077 bytes (393 KB) for 2 cores May 19 16:42:10.752363 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: *** Operational MODE: preforking *** May 19 16:42:10.755877 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: *** uWSGI is running in multiple interpreter mode *** May 19 16:42:10.755877 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: spawned uWSGI master process (pid: 124110) May 19 16:42:10.755877 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: spawned uWSGI worker 1 (pid: 124122, cores: 1) May 19 16:42:10.755877 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: spawned uWSGI worker 2 (pid: 124123, cores: 1) May 19 16:42:10.755877 dv-cinder-842433-1-iscsi devstack@n-api.service[124110]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 19 16:42:10.752675 dv-cinder-842433-1-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 19 16:42:12.047686 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 16:42:12.121094 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 19 16:42:12.854432 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:42:12.854432 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: from cryptography.utils import int_from_bytes May 19 16:42:12.854822 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:42:12.854822 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: from cryptography.utils import int_from_bytes May 19 16:42:12.954176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:42:12.954176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: from cryptography.utils import int_from_bytes May 19 16:42:12.954628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 19 16:42:12.954628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: from cryptography.utils import int_from_bytes May 19 16:42:15.347845 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 16:42:15.348773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 16:42:15.348773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 16:42:15.349058 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 16:42:15.349682 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 16:42:15.349682 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.349989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.350313 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.350645 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.350985 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.351305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.351633 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.351963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.352301 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.352581 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.352887 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.353266 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842433-1-iscsi {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.353570 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.353881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.354200 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.354541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.354833 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.355158 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.355473 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.355985 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.356746 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.357060 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.357505 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.357867 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.358163 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.358467 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.358812 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.359094 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.359416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.359747 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.360137 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842433-1-iscsi {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.360465 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.360781 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.361091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.361567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.362090 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.362430 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.363102 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.363102 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.363678 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.363678 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.363966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.364219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.364476 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.364745 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.365831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.365831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.365831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.365831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.367170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.367170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.367170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.367170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.367785 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.367785 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.371790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.371790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.371790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.371790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.371790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.371790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.371790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.373541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.375333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.377272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.379627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.379627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.379627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.379627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.379627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.379627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.379627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.381763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.381763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.381763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.381763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.381763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.381763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.381763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.382805 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.382805 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.382805 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.383584 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.383584 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.383953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.384132 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.384387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.384696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.385022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.385365 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.385676 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.386005 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.386323 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.386632 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.386952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.387260 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.387576 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.387889 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.388192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.388508 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.388822 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.389132 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.389464 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.389852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.390062 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.390369 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.391160 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.391160 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.391919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.391919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.391919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.392631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.392631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.393084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.393084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.393579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.393813 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.394635 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.394967 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.395291 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.395743 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.395985 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.396262 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.396579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.396901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.397255 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.397575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.397892 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.398208 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.398533 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.398855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.399188 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.399661 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.401567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.401567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.401567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.401567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.401567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.401567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.404358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.408214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.410630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.413790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.413790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.413790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.413790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.417524 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.418078 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.418546 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.418979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.419451 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.419887 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.420387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.420843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.421230 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.422289 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.422289 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.422289 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.423989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.423989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.423989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.423989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.424697 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.424956 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.427359 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.427854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.428767 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.429333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.429915 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.431338 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.431796 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.432253 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.432721 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.433205 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.433757 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.434108 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.434562 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.434985 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.435425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.435865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.436295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.436714 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.437139 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.437590 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.438017 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.438452 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.438874 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.439289 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.439778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.440192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.440667 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.442994 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.442994 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.442994 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.442994 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.442994 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.443493 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.443947 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.444376 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.444891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.445316 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.445731 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.446159 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.446582 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.447094 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.447689 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.447798 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.448261 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.448689 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.449067 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.449519 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.449964 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.450402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.450868 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.451258 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.451840 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.452100 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.452526 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.454925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.454925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.454925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.454925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.454925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.454925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.454925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.455952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.456236 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.457368 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.457680 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.458106 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.458538 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.458961 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.459403 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.459818 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.460257 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.460663 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.461100 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.461584 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.462036 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.462460 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.462980 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.463314 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.463734 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.464459 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.464459 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.465069 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.466800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.466800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.466800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.466800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.466800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.467544 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.467852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.468225 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.468647 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.469066 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.469525 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.470966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.470966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.470966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.470966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.471578 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.472011 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.472488 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.472946 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.473407 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.473832 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.474255 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.476168 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.476168 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.476168 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.476168 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.476168 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.476782 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.477388 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.477661 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.478092 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.478538 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.478970 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.479396 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.479825 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.480265 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.480685 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.481112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.482809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.482809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.482809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.482809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.482809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.484856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.484856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.484856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.484856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.485711 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.485999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.486439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.487784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.487784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.487784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.488523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.488523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.490307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.490307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.490307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.490307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.490307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.492707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.492707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.492707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.492707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.492707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.492707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.493835 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.493835 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.494117 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.494428 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.494817 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.495232 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.495627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.496015 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.496398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.496779 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.497136 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.497472 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.497819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.498157 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.498509 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.498827 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.499142 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.499476 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.499791 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.500102 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.500420 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.500738 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.501052 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.501383 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.501702 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.502016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.502329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.502643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.502950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.503262 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.504115 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.504432 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.504744 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.505054 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.505384 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.505700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.506012 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.506319 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.506631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.506938 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.507257 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.507568 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.507876 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.508442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.508754 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.509065 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.509396 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.509731 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.510051 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.510392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.510679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.510994 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.511300 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.511610 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.511924 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.512254 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.512576 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.512934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.513421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.513530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.513817 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.514125 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.514439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.514861 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.515481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.515481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.515669 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.515952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.516275 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.516589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.516902 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.517245 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.517555 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.517907 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.518217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.518580 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.518893 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.519778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.520102 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.520424 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.520741 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.521060 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.521398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.521720 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.522039 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.522357 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.522667 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.522974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.523303 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.523616 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.523930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.524299 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.524589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.524919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.525254 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.525572 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.525888 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.526204 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.527458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.527458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.527458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.527458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.528565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.528565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.528565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.529392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.529392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.529392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.530203 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.530203 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.530203 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.530936 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.530936 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.531402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.531402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.532110 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.532110 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.532662 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.532895 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.533465 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.533465 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.533928 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.533928 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.534369 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.534638 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.534992 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.535311 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.535623 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.535938 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.536247 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.536554 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.536870 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.537220 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.537534 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.537845 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.538154 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.538482 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.538792 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.539119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.539548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.539863 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.540172 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.540600 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.540911 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.541253 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.541580 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.541979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.542217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.542524 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.542845 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.543158 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.543490 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.543817 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.544137 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.544452 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.544762 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.545036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 19 16:42:15.545924 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.546160 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 19 16:42:15.546425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.546425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.546863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 19 16:42:15.547098 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.547335 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 19 16:42:15.547576 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.547839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 19 16:42:15.548075 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.548309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.548539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.548796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.549011 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.549292 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.549520 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.549769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.550033 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.550307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.550585 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.550837 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.551081 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.551334 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.551555 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.551801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.552085 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.552453 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.552673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.552928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.553310 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.553552 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.554101 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.554338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-842433-1-iscsi {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.554595 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.554827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.555057 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.555307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.555544 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.555776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.555999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.556238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.556456 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.556707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.556954 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.557209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.557448 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.557708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.557945 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.557945 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.558419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.558692 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.558923 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.559141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.559397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.559671 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.559895 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.560174 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.560410 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.560654 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.560911 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.561131 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.561428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.561667 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.561898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.562152 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.562473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.562747 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.562979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.563263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.563498 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.563760 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.564018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-842433-1-iscsi {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.564481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.564721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.564952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.565236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.565481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.565481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.566506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.566940 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.567229 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.567487 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.567775 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.568023 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.568247 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.568492 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.568716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.568964 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.569271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.569521 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.569765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.570011 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.570245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.570480 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.570726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.571002 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.571310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.571536 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.571786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.572033 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.572281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.572510 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.572763 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.572981 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.573326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.573578 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.573815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.574042 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.574288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.574715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.574975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.575216 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.575442 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.575683 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.575918 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.576189 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.576429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.576645 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.576888 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.577120 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.577403 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.577661 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.577890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.578131 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.578374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.578597 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.578855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.579091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.579317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.579562 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.579781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.580031 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.580288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.580519 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.580766 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.580987 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.581293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.581612 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.582369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.582369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.582808 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.583040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.583264 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.583503 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.583739 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.583992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.584210 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.584452 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.584713 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.584971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.585227 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.585470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.585707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.585945 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.586176 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.586445 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.36 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.586678 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.586935 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.36 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.586935 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.587372 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.587621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.587861 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.588100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.588325 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.588560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.588781 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.589037 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.589313 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.589556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.589795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.590035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.590281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.590523 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.590743 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.590987 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.591214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.591449 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.591690 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.591939 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.592184 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.592424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.592645 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.592905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.593140 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.593484 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.593732 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.593961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.593961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.594409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.594665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.594884 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.595121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.595380 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.595690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.595931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.596212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.596441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.596682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.596927 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.597253 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.597521 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.597760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.597982 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.598221 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.598449 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.598677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.598927 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.599171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.599392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.599631 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.599854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.600081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.600336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.600556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.600790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.601029 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.601295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.601539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.601784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.602032 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.602293 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.602534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.602809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.603065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.603313 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.603562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.603909 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.604144 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.604377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.604624 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.604852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.605102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.605409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.605649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.605948 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.606178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.606479 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.606769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.606769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.607227 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.607465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.607698 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.607993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.608250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.608485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.608726 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.608977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.609275 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.609514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.609755 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.609989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.610296 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.610607 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.610881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.611138 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.611379 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.611611 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.611840 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.612105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.612329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.612546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.612827 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.613071 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.613394 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.613637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.613858 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.614090 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.614341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.614572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.614798 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.615014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.615167 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.615402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.615553 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.615709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.615709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.616001 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.616159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.616323 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.616480 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 19 16:42:15.616630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.616778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.616935 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.617104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.617298 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.617458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.617607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.617762 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.617911 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.618061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.618221 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.618383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.618533 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.618681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.618829 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.618993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.619154 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.619303 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.619451 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.619599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.619761 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.619919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.620076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.620241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.620390 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.620546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.620695 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.620852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.621012 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.621254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.621411 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.621411 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.621693 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.621854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.622014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.622162 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.622311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.622458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.622629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.622785 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.622942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.623101 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.623257 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.623408 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.623565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.623722 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.623871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.624018 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.624167 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.624323 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.624487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.624639 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.624797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.624961 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.625120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.625307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.625468 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.625618 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.625767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.625922 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.626079 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.626236 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.626236 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.626529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.626529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.626811 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.626977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.627140 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.627556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.627720 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.627877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.628026 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.628173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.628330 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.628330 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.629214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.629214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.629517 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.629669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.629838 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.629988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.630137 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.630285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.630434 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.630591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.630742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.630906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.631132 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.631294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.631442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.631606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.631765 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.631932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.631932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.632223 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.632385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.632552 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.632702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.632850 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.633007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.633449 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.633601 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.633770 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.633922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.634070 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.634238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.634387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.634550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.634708 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.634858 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.635008 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.635157 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.635305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.635461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.635622 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.635622 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.635905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.636082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.636232 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.636398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.636548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.636697 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.636853 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.637004 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.637200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.637368 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.637518 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.637666 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.637815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.637963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.638132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.638132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.638414 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.638564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.638710 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.638859 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.639015 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.639173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.639322 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.639478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.639627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.639790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.639963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.640113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.640270 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.640270 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.640551 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.640712 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.640862 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.641010 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.641189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.641345 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.641510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.641668 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.641825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.641984 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.642141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.642298 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.642466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.642668 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.642827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.642983 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.643158 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.643317 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.643476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.643625 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.643774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.643933 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.644666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.644825 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.644984 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.645142 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.645396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.645556 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.645796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.645951 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.646201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.646366 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.646545 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.646714 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.646883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.647032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.647195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.647352 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.647511 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.647674 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.647830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.647991 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.648148 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.648305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.648454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.648604 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.648759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.648958 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.649245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.649426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.649586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.649743 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.649900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.650090 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.650242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.650398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.650582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.650759 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.650946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.651163 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.651350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.651508 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.651660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.651823 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.651986 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.652164 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.652164 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.652481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.652632 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.652782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.652945 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.653118 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.653340 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.653515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.653683 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.653842 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.653999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.654149 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.654315 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.654473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.654631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.654781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.654931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.655080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.655229 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.655394 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.655552 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.655702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.655852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.655999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.656155 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.656314 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.656476 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.656632 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.656789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.656947 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.657096 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.657328 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.657504 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.657655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.657803 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.657960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.658115 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.658272 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.658421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.658577 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.658726 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.658881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.659030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.659187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.659343 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.659509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.659689 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.659845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.659993 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.660154 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.660303 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.660452 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.660600 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.660748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.660905 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661076 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661290 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661410 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661505 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661705 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.661916 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662137 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662411 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662603 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662786 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.662974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663158 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663337 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663436 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663616 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.663963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664179 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664274 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664361 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664731 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.664895 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665224 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665381 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665685 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.665923 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666187 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666450 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666662 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.666873 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667098 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667280 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667367 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667896 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124123) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.667992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.668620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.669826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.670924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.671999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.672995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.673548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.674562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.676192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.676192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.676192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.676192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.676465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.676740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.677057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.677404 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.677739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.678066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.678379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.678699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.679011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.679324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.679638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.680485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.680485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.680646 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.680857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.681183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.681497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.681828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.682145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.682457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.682769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.683078 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.683432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.683744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.684110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.684425 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.684799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.685188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.685433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.685754 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.686075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.686387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.686708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.687063 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.687346 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.687653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.687963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.688282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.688602 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.688922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.689271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.689604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.689934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.690250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.690569 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.691400 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.691729 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.692045 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.692363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.692684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.693002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.693346 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.693668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.693987 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.694299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.694617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.694932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.695247 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.695726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.695904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.696218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.696528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.696839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.697184 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.697486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.697936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.698256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.698577 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.698883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.699199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.699663 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.699872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.700158 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.700460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.700992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.701352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.701671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.702039 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.702396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.702799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.703050 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.703224 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Registered counter for database nova_api May 19 16:42:15.703384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.703697 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.704007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.704318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.704648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.704958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.705309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.705750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.706070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.706380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.707369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.707689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.708007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.708341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.708670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.709000 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.709337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.710904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.710904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.710904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.710904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.710904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.711311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.711549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.711873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.712205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.712530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.712992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.713405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.713649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.714036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.714295 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.714724 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.714940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.715249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.715577 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.715958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.716636 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.716636 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.717004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.717191 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.717436 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.717752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.718064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.718383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.718923 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.719964 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.720517 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.720517 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.720995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.721313 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.721512 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.721817 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.722160 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.722496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.722794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.723615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.723615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.724153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.724153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.724527 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.724726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.725045 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.725418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.725760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.726065 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:15.726200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.726515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.726876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.727478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.727478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.728822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.728822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.728822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.728822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.729317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.729423 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.729680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.729968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.730303 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.730618 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.730950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.731363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.731594 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.731893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.732202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.732556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.732869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.733237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.733571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.733909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.734239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.734558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.734773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:15.734878 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.735205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.735531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.735973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.736186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.736512 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.736838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.737173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.737492 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.738364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.738682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.739009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.739582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.739921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.740244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.740564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.740883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.741226 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.741549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.741870 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.742187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.742507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.742825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.743164 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.743494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.743828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.744176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.744504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.744826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.745179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.745504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.745872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.755617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.756486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.757531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.758635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.759560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.759560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.759560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.759560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.759560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.759560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.759560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.760080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.760080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.760392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.760712 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.761030 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.761381 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.761696 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.762007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.762334 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.762648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.762959 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.763268 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.763594 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.763905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.764219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.764530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.764839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.765186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.765507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.765817 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.766126 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.766448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.766758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.767360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.767360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.767670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.767978 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.768286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.768601 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.768910 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.769280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.769690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.769898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.770276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.770613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.770926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.771236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.771566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.771883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.772212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.772531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.772848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.773227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.773550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.774141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.774482 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.774812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.775162 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.775504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.775824 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.776128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.776448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.776779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.777100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.777440 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.777756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.778075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.778389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.778701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.779015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.779326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.779641 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.779951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.780269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.780583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.780898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.781277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.781602 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.781920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.782246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.782568 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.782881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.783201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.783515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.783826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.784154 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.784487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.784839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.785173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.785623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.786056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.786312 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.786598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.786901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.787199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.787536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.787849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.788173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.788491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.788826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.789188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.789526 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.789868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.790333 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.790564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.790815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.791093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.791415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.791728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.792033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.792342 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.792652 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.792961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.793317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.793657 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.793908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.794247 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.context [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b5ff4c6-24cc-4cd2-b226-22d75c194482(cell1) {{(pid=124123) load_cells /opt/stack/nova/nova/context.py:464}} May 19 16:42:15.794470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.794634 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.794791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.795173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.795505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.795732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.796323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.796531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.796713 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.796968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.797298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.797608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.797917 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.798811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.798811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.799490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.799490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.799770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.799911 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.800165 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.801036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.801389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.801721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.802036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.802374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.802693 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.802833 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:42:15.803011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.803330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.803647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.803961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.804277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.804616 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.804948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.805263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:42:15.805402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.805617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.805943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.806172 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:42:15.806306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.806584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.806912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.807252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.807564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.807882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.808201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.808448 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:42:15.808583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.808815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.809137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.809478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.809811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.810151 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.810464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.810795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.810971 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Registered counter for database nova_cell0 May 19 16:42:15.811118 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.811479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.811797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.812150 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.812486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.812806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.813125 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.813789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 19 16:42:15.814046 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124122) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 19 16:42:15.815361 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Registered counter for database nova_cell1 May 19 16:42:15.825326 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:15.826578 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:15.832410 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:15.838842 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:15.875202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Registered counter for database nova_api May 19 16:42:15.898585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:15.905893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:15.966964 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.context [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),3b5ff4c6-24cc-4cd2-b226-22d75c194482(cell1) {{(pid=124122) load_cells /opt/stack/nova/nova/context.py:464}} May 19 16:42:15.971857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:42:15.973746 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:42:15.974624 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:42:15.976761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:42:15.978992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Registered counter for database nova_cell0 May 19 16:42:15.983426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Registered counter for database nova_cell1 May 19 16:42:15.990484 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO dbcounter [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Registered counter for database nova_cell0 May 19 16:42:15.992084 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:15.995134 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:15.997623 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_db.sqlalchemy.engines [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124123) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:15.999601 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:16.002087 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writer thread running {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:16.156639 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:16.168015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO dbcounter [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Registered counter for database nova_cell0 May 19 16:42:16.178428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_db.sqlalchemy.engines [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124122) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 19 16:42:16.183805 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writer thread running {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 19 16:42:16.332459 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:42:16.339978 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:42:16.630398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:42:16.638577 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:42:16.685087 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:42:16.692367 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: WARNING keystonemiddleware.auth_token [None req-a915ad06-5321-460a-b590-e4211a6f9487 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:42:16.697552 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c72c129c0 pid: 124123 (default app) May 19 16:42:16.871715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 19 16:42:16.878179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: WARNING keystonemiddleware.auth_token [None req-9990c2ac-8dc3-4248-b9e1-8be16c72990f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 19 16:42:16.884348 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x564c72c129c0 pid: 124122 (default app) May 19 16:42:58.429921 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:58.431234 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:58.432988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:58.435101 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:59.212943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:59.216319 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:59.219930 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:42:59.223691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:00.322398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5dd64def-abb9-4994-a4ed-c70e7a73922a tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Action: 'create', calling method: .version_select at 0x7f489959f4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1873325860"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:00.805004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5a1f5cdb-b22e-48d7-a17d-42f03360b1c8 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Action: 'create', calling method: .version_select at 0x7f489959a790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-151015048", "metadata": {"Type": "work"}}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:03.014957 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5dd64def-abb9-4994-a4ed-c70e7a73922a tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 4.591507 May 19 16:43:03.027684 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 1/1] 10.222.0.36 () {60 vars in 1154 bytes} [Thu May 19 16:42:58 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 4606 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 16:43:03.309381 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-811098148", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "networks": [{"uuid": "bf3505d9-6ebb-447d-ba39-16bf2df77370"}]}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:03.518938 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] validate_networks() for [('bf3505d9-6ebb-447d-ba39-16bf2df77370', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:43:03.807637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5a1f5cdb-b22e-48d7-a17d-42f03360b1c8 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 4.613378 May 19 16:43:03.808467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 1/2] 10.222.0.36 () {60 vars in 1155 bytes} [Thu May 19 16:42:59 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 4616 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 19 16:43:03.825310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e74419b6-5cae-4210-9331-cb831eda50d1 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4899469700>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:04.054272 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e74419b6-5cae-4210-9331-cb831eda50d1 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0" status: 200 len: 345 microversion: 2.1 time: 0.232848 May 19 16:43:04.055360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 2/3] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:03 2022] GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 => generated 345 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:04.078321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0749c2cb-dd3a-40f4-97d0-f512b9f69343 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f4899469820>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:04.266628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0749c2cb-dd3a-40f4-97d0-f512b9f69343 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.200470 May 19 16:43:04.269280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 3/4] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:04 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:05.071219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ab6a4599-8ee6-4470-aa39-87db977fe239 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4899469ee0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:05.281321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ab6a4599-8ee6-4470-aa39-87db977fe239 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0" status: 200 len: 346 microversion: 2.1 time: 0.213759 May 19 16:43:05.281971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 4/5] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:05 2022] GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 => generated 346 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:43:05.302479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a4d3d8d0-d494-4c9f-92a3-f63af5ac67a3 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f489947f5e0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:05.479503 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a4d3d8d0-d494-4c9f-92a3-f63af5ac67a3 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 353 microversion: 2.1 time: 0.196600 May 19 16:43:05.481679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 5/6] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:05 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 353 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:05.489204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fa35359b-e7b0-4409-b395-d3a6c3534bdb tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Action: 'create', calling method: .version_select at 0x7f4899469dc0>, body: {"snapshot": {"volume_id": "c36fbadf-da72-46ed-a55b-91f4233cc9a0", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1876401949"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:06.180778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fa35359b-e7b0-4409-b395-d3a6c3534bdb tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.696580 May 19 16:43:06.182593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 6/7] 10.222.0.36 () {60 vars in 1161 bytes} [Thu May 19 16:43:05 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 700 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:06.188306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fd9608e2-46a3-4027-a545-3dbbc762951a tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f489947f670>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:06.489741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fd9608e2-46a3-4027-a545-3dbbc762951a tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 353 microversion: 2.1 time: 0.305608 May 19 16:43:06.490468 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 7/8] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:06 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 353 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:06.495314 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7fa69a7f-4282-4f3a-adba-0a27c0352b2a tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f489947f9d0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:06.558534 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:43:06.559095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:43:06.559442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:43:06.559989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:43:06.560403 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:43:06.567072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7fa69a7f-4282-4f3a-adba-0a27c0352b2a tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.075376 May 19 16:43:06.568298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 8/9] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:06 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:06.577928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0fe9f93c-c265-4e14-a071-4821805cd016 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f4899469c10>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:06.624406 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:06.625183 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:06.626621 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:06.630342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:06.719503 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Getting quotas for project 16022d299eda48e6bf4675055870a140. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:43:06.732803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0fe9f93c-c265-4e14-a071-4821805cd016 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 202 len: 0 microversion: 2.1 time: 0.161931 May 19 16:43:06.737552 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Getting quotas for user 26bcad09cb7749d780d151d3d2862795 and project 16022d299eda48e6bf4675055870a140. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:43:06.738872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 9/10] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:43:06 2022] DELETE /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:43:06.761458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9310993c-3e78-4655-bcbd-63f3b2403056 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4899469dc0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:06.795800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:43:06.799039 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:43:06.887072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9310993c-3e78-4655-bcbd-63f3b2403056 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.136535 May 19 16:43:06.888245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 10/11] 10.222.0.36 () {58 vars in 1139 bytes} [Thu May 19 16:43:06 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:06.895366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-479d7de1-984e-4071-ac79-1872bbcbc874 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f489947f820>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:07.051159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-479d7de1-984e-4071-ac79-1872bbcbc874 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.159893 May 19 16:43:07.052382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 11/12] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:06 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:07.059792 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-17b63aa5-6297-4ca6-a0d9-6c60c23ab543 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.030692 May 19 16:43:07.060440 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 2/13] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:43:03 2022] POST /compute/v2.1/servers => generated 380 bytes in 4032 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:43:07.063369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-af5c03a5-5a78-4c70-b5f0-19cd1a96bfe9 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f489947f430>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:07.085641 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f5666a19-8e7d-4162-892e-e72d73d68151 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:07.086283 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f5666a19-8e7d-4162-892e-e72d73d68151 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:07.162925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-af5c03a5-5a78-4c70-b5f0-19cd1a96bfe9 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.108133 May 19 16:43:07.164732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 12/14] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:07 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:07.642761 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f5666a19-8e7d-4162-892e-e72d73d68151 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:07.686939 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f5666a19-8e7d-4162-892e-e72d73d68151 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1214 microversion: 2.1 time: 0.619739 May 19 16:43:07.687849 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 3/15] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:07 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1214 bytes in 621 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:08.064585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-17f96179-6edf-49b2-a129-fbb7b2ef7132 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f489947fd30>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:08.177329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1c70ea46-6052-47af-bc37-eef499385437 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f489832a280>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:08.227950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-17f96179-6edf-49b2-a129-fbb7b2ef7132 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.167783 May 19 16:43:08.228549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 13/16] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:08 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:08.284080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1c70ea46-6052-47af-bc37-eef499385437 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.110967 May 19 16:43:08.288452 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 4/17] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:08 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:43:08.705439 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-949e79a4-982a-4ece-8b87-4de7bc867971 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:08.706495 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-949e79a4-982a-4ece-8b87-4de7bc867971 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:09.001744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-949e79a4-982a-4ece-8b87-4de7bc867971 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:09.045396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-949e79a4-982a-4ece-8b87-4de7bc867971 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1214 microversion: 2.1 time: 0.344513 May 19 16:43:09.051899 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 14/18] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:08 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1214 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:09.259566 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cee77648-5e3e-47b2-adaa-fddbb27e009b tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f4898339700>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:09.300270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d299b102-d346-4d7c-b08d-0d31e6dfef79 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4899441430>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:09.432917 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cee77648-5e3e-47b2-adaa-fddbb27e009b tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.192671 May 19 16:43:09.434208 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 5/19] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:09 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:09.464551 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d299b102-d346-4d7c-b08d-0d31e6dfef79 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.169011 May 19 16:43:09.466196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 15/20] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:09 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:10.073592 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:10.074412 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:10.093365 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:10.097440 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:10.098594 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:10.105745 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:10.231411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1386847953", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:10.350056 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:10.364338 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c96ac253-5563-48e9-b562-cd534d8f9fcb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1218 microversion: 2.1 time: 0.299758 May 19 16:43:10.365409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 6/21] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:10 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1218 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:10.446280 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-93e32105-fcc7-48bb-ab8a-61d3d4b4154c tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f48982a7ca0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:10.460407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] validate_networks() for [('ca9f7fe2-13d8-4e5e-a0b7-ed1642c0a592', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:43:10.570762 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-93e32105-fcc7-48bb-ab8a-61d3d4b4154c tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.127088 May 19 16:43:10.572180 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 7/22] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:10 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:43:10.599395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d1d67b67-7ae0-419f-93d2-8e7ac18b8f8b tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f48982b55e0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:10.675427 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d1d67b67-7ae0-419f-93d2-8e7ac18b8f8b tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.092107 May 19 16:43:10.677493 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 8/23] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:10 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:11.383539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:11.384910 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:11.413879 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:11.414347 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:11.415155 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:11.415604 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:11.724487 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:11.744999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1b96c1d8-3217-48ad-91f2-7f0e0a51b919 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1218 microversion: 2.1 time: 0.366153 May 19 16:43:11.750021 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 9/24] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:11 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1218 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:11.771263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d53b03a0-a838-4d5e-b86e-ab6a606a48b0 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f48982b5670>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:11.924076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d53b03a0-a838-4d5e-b86e-ab6a606a48b0 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.170361 May 19 16:43:11.930649 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 10/25] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:11 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:11.936008 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a0e66524-7968-4f4f-a229-01252b615897 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f48982b54c0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:12.022070 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a0e66524-7968-4f4f-a229-01252b615897 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.089750 May 19 16:43:12.023090 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 11/26] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:11 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:12.573589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6462448e-1f5d-43cf-89fb-0ccd0039efc9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: .version_select at 0x7f48982c1310>, body: {"keypair": {"name": "tempest-keypair-880856713", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAZskaEQW1vPm3dzpDUII91Y3rRMr/Wo2c6v6ETScDb/i9D1skWWxYks53bB0y3LYKuzn2pqzDgpge+hWBlfqdWbJolUlCdB5adQiB9gcC/Y+MD0qAn4ksaEwDSbf3JSTg=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:12.608804 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-6462448e-1f5d-43cf-89fb-0ccd0039efc9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:43:12.615572 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-6462448e-1f5d-43cf-89fb-0ccd0039efc9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:43:12.675529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:43:12.678070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:43:12.679091 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:43:12.679738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:43:12.680295 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:43:12.688017 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6462448e-1f5d-43cf-89fb-0ccd0039efc9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.241701 May 19 16:43:12.691541 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 12/27] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:43:12 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:12.714028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:12.714907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:12.715855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:12.717291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:12.765180 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:43:12.771779 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:12.776779 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:12.781525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for user 6e88db1bf9294decaf171756772a5066 and project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:43:12.787886 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:12.788352 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:12.789206 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:12.794769 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:12.827006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:43:12.830406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:43:13.032934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:13.035785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d6400ee5-7cd3-4c00-84d3-ff18ffc4b8b1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.934581 May 19 16:43:13.037075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 16/28] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:43:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 2937 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:43:13.046791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c8f96929-5600-4d57-bfca-844aed8ad13b tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f4898b394c0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:13.059920 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-91a2ad3e-d4d9-4a58-9649-cb98a38ac424 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1266 microversion: 2.1 time: 0.292947 May 19 16:43:13.065019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 13/29] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:12 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:13.099314 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b241f184-b6a1-48bf-be0b-d370f2afd57e tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4898268550>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:13.225222 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c8f96929-5600-4d57-bfca-844aed8ad13b tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.186554 May 19 16:43:13.225946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 17/30] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:13 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:13.229074 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b241f184-b6a1-48bf-be0b-d370f2afd57e tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 288 microversion: 2.1 time: 0.162490 May 19 16:43:13.231792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e7fde84a-ca12-4643-b854-640e692c2fba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:13.233028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e7fde84a-ca12-4643-b854-640e692c2fba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:13.234141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 14/31] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:13 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 288 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:13.246110 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9ad59875-eac7-479c-8af3-50d0577eccda tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4898223700>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:13.505669 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9ad59875-eac7-479c-8af3-50d0577eccda tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "DELETE /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 202 len: 0 microversion: 2.1 time: 0.264262 May 19 16:43:13.506567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 15/32] 10.222.0.36 () {58 vars in 1253 bytes} [Thu May 19 16:43:13 2022] DELETE /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 0 bytes in 266 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:43:13.515393 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5214cf44-8b55-4a5e-8065-afe234f36547 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4898223820>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:13.716584 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5214cf44-8b55-4a5e-8065-afe234f36547 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.205014 May 19 16:43:13.721344 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 16/33] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:13 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:14.007128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e7fde84a-ca12-4643-b854-640e692c2fba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:14.037454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e7fde84a-ca12-4643-b854-640e692c2fba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1222 microversion: 2.1 time: 0.810044 May 19 16:43:14.041527 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 18/34] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:13 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1222 bytes in 815 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:14.079151 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:14.081006 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:14.088814 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:14.094019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:14.100156 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:14.101737 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:14.183410 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2036486128", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:14.276784 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] validate_networks() for [('ca9f7fe2-13d8-4e5e-a0b7-ed1642c0a592', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:43:14.442828 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:14.455783 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e01f5905-9045-420b-9222-3e7bac324695 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1274 microversion: 2.1 time: 0.381226 May 19 16:43:14.456763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 17/35] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:14 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1274 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:14.466796 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e7a7516f-d032-4247-b047-91785a6e5e8f tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f48982233a0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:14.668849 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e7a7516f-d032-4247-b047-91785a6e5e8f tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.208344 May 19 16:43:14.674596 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 18/36] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:14 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:14.732163 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-29a0b4cb-ec2a-45b9-bdf6-fa5ce9415d19 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f48982b55e0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:14.799642 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-29a0b4cb-ec2a-45b9-bdf6-fa5ce9415d19 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.071993 May 19 16:43:14.800967 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 19/37] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:14 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:15.474173 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:15.474903 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:15.483973 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:15.488292 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:15.491674 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:15.492245 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:15.824515 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:15.838660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4835087b-5971-4247-bc37-34313ec26a84 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1274 microversion: 2.1 time: 0.369110 May 19 16:43:15.844371 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 20/38] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:15 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1274 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:15.862472 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-38becf12-665a-4bc4-9248-825365d9bd0f tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f4898223ca0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:15.920345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:43:15.921054 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:43:15.921450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:43:15.921953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:43:15.922384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:43:15.947264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:15.947866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:15.948704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:15.955251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:15.993666 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-38becf12-665a-4bc4-9248-825365d9bd0f tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 200 len: 352 microversion: 2.1 time: 0.145362 May 19 16:43:16.001819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 21/39] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:15 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 352 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:16.002089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:43:16.002234 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3ec371ea-d874-4c01-b3c7-d56363ba1bfd tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4898223e50>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:16.002364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for user 6e88db1bf9294decaf171756772a5066 and project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:43:16.015655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:43:16.018613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:43:16.080984 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3ec371ea-d874-4c01-b3c7-d56363ba1bfd tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 200 len: 287 microversion: 2.1 time: 0.085304 May 19 16:43:16.099888 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-19bab3bd-0e82-44d1-964d-2a4aa0593bb8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.925838 May 19 16:43:16.101448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 19/40] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:43:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 1928 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:43:16.106293 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 22/41] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:15 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 287 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:16.113776 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-44483c2e-ba92-4b1a-b411-2b6ccb584793 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:16.114416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-44483c2e-ba92-4b1a-b411-2b6ccb584793 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:16.332820 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f9a3aaf7-ba7b-4043-a312-570d773a3844 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'create', calling method: .version_select at 0x7f4898b393a0>, body: {"keypair": {"name": "tempest-keypair-1776713100", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFw1hwLQzcrGWdSK5nwMI+jXQjz/4oqEz0Mg6z4c5ZDzsbMk1ZPGXJFYkQLnbaQCymaPi90IsUanMqMHhIZYQoZLcb//0oX+3wh0bGSvFP9aN/6fS0lLn+Tqy9dPiCaNqA=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:16.412350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f9a3aaf7-ba7b-4043-a312-570d773a3844 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:43:16.418454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f9a3aaf7-ba7b-4043-a312-570d773a3844 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for user 86b78ffb46894509bf8e81a154073885 and project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:43:16.448592 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-44483c2e-ba92-4b1a-b411-2b6ccb584793 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:16.486673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-44483c2e-ba92-4b1a-b411-2b6ccb584793 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1222 microversion: 2.1 time: 0.377990 May 19 16:43:16.490952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 23/42] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:16 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1222 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:16.561924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f9a3aaf7-ba7b-4043-a312-570d773a3844 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.459082 May 19 16:43:16.572715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 20/43] 10.222.0.36 () {62 vars in 1199 bytes} [Thu May 19 16:43:16 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 470 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 16:43:16.862329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:16.863030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:16.878187 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:16.885666 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:16.894609 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:16.903161 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:16.903919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:17.011952 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3588a0c6-038c-466a-af26-8afd73ee95a0 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Calling method '.version_select at 0x7f4898b47550>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:17.115141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-3588a0c6-038c-466a-af26-8afd73ee95a0 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] HTTP exception thrown: Volume f6a7963a-f012-48fb-ac27-f58af0a9e3f8 could not be found. May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3588a0c6-038c-466a-af26-8afd73ee95a0 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Request method failure captured: May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 HTTP/1.1 May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOTkce1TmmQN_zmi0cDzoGOR3q-F70adZ1bFqlp5HCwBTHVywGihaFIOrgPkmn9KbavYVfAxE26w7NMozRZlh6GU2YBWjmkdrFwAu6bi7iwwFim6d_K2npoz8m6TKq9f3qe7HOxc02sXtRNuqwDEV6afE7G9AHk_-0_jJhzJ3RaN_w May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: e0ed7ea223d744b283eacf61514bc9aa May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesGetTestJSON-985578825 May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:43:17.120208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/e0ed7ea223d744b283eacf61514bc9aa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e0ed7ea223d744b283eacf61514bc9aa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_e0ed7ea223d744b283eacf61514bc9aa", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/e0ed7ea223d744b283eacf61514bc9aa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesGetTestJSON-985578825 May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: e0ed7ea223d744b283eacf61514bc9aa May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesGetTestJSON-985578825 May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesGetTestJSON-985578825-project May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: cd00835e169a4c42bea59e8204e7c09e May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesGetTestJSON-985578825-project May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Volume f6a7963a-f012-48fb-ac27-f58af0a9e3f8 could not be found. May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'f6a7963a-f012-48fb-ac27-f58af0a9e3f8'} May 19 16:43:17.122534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume f6a7963a-f012-48fb-ac27-f58af0a9e3f8 could not be found. (HTTP 404) (Request-ID: req-84a51517-20c6-4424-a0a8-b7aabaf34da9) May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:17.123667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:17.124933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume f6a7963a-f012-48fb-ac27-f58af0a9e3f8 could not be found. May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 16:43:17.127109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume f6a7963a-f012-48fb-ac27-f58af0a9e3f8 could not be found. May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume f6a7963a-f012-48fb-ac27-f58af0a9e3f8 could not be found. May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.128647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3588a0c6-038c-466a-af26-8afd73ee95a0 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] Returning 404 to user: Volume f6a7963a-f012-48fb-ac27-f58af0a9e3f8 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:43:17.130060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3588a0c6-038c-466a-af26-8afd73ee95a0 tempest-VolumesGetTestJSON-985578825 tempest-VolumesGetTestJSON-985578825-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8" status: 404 len: 109 microversion: 2.1 time: 0.116786 May 19 16:43:17.137324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 21/44] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:17 2022] GET /compute/v2.1/os-volumes/f6a7963a-f012-48fb-ac27-f58af0a9e3f8 => generated 109 bytes in 130 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:43:17.158520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b06d92a2-274a-4419-a002-5bc650bd7c34 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f489947f8b0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:17.239290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-b06d92a2-274a-4419-a002-5bc650bd7c34 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] HTTP exception thrown: Snapshot b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 could not be found. May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b06d92a2-274a-4419-a002-5bc650bd7c34 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Request method failure captured: May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 HTTP/1.1 May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOS6Q_TTV4tHUFfmwmwyomCXgRYCOvsQqBt1EO-Xt-CqZxs6183_rkfXPrZFhNP-C1GGMvnCcvHoTYoZCMvn5UtsXrbKpG5w1GSHu4wiCtUaCzGbcKOlOxcnc5JjbOi_6eFfpeIHgGTNLmIzopG19h35KXH5gJchqwdF2ARVe3WX0U May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:43:17.242142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a6eafe486fe4b5cadac660a921721c6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: a7a919d815074ed1aba725a56e198b47 May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Snapshot b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 could not be found. May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'b63aafdc-accb-4fe4-9cc5-cfb6f21bf096'} May 19 16:43:17.243505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 could not be found. (HTTP 404) (Request-ID: req-1351b853-5141-4744-b7b3-043133440d24) May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.244271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:17.245844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 could not be found. May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 19 16:43:17.246860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 could not be found. May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 could not be found. May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b06d92a2-274a-4419-a002-5bc650bd7c34 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Returning 404 to user: Snapshot b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b06d92a2-274a-4419-a002-5bc650bd7c34 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096" status: 404 len: 111 microversion: 2.1 time: 0.107929 May 19 16:43:17.247885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 22/45] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:43:17 2022] GET /compute/v2.1/os-snapshots/b63aafdc-accb-4fe4-9cc5-cfb6f21bf096 => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:43:17.263192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-89b5c13d-2c01-4eae-8442-7836d6044cac tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f48982bb820>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:17.432660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:17.490181 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ed4c581f-a376-406f-9f5e-7d32165ceed7 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1272 microversion: 2.1 time: 0.616623 May 19 16:43:17.491962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 24/46] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:16 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1272 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:17.520046 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:17.520932 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:17.521535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-89b5c13d-2c01-4eae-8442-7836d6044cac tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0" status: 202 len: 0 microversion: 2.1 time: 0.270476 May 19 16:43:17.522430 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 23/47] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:43:17 2022] DELETE /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:43:17.530871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c985a698-49b9-428e-8b47-255522411382 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f48982bbf70>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:17.551557 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:17.555615 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:17.559292 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:17.566818 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:17.711317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c985a698-49b9-428e-8b47-255522411382 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0" status: 200 len: 345 microversion: 2.1 time: 0.184295 May 19 16:43:17.712291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 24/48] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:17 2022] GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 => generated 345 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:18.445293 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:18.461250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2f467ec5-f15d-4cf8-8fb4-56cdd95cae70 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1226 microversion: 2.1 time: 0.944062 May 19 16:43:18.473815 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 25/49] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:17 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1226 bytes in 960 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:18.487677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1980615835", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84ed37a0-33b7-474f-8c60-1eac20f29b87"}], "security_groups": [{"name": "tempest-securitygroup--1379613167"}], "key_name": "tempest-keypair-880856713", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:18.509837 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:18.511069 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:18.549463 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:18.550028 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:18.554481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:18.557573 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:19.911843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] validate_networks() for [('84ed37a0-33b7-474f-8c60-1eac20f29b87', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:43:20.379083 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:20.446904 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a6be4c8f-9115-4927-9dce-d9e7d3e50b3b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 1.941880 May 19 16:43:20.447444 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 26/50] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:18 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 1944 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:20.467477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7d33adb8-d923-48e3-ac03-d01f51f5c595 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4898223430>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:20.566064 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-7d33adb8-d923-48e3-ac03-d01f51f5c595 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] HTTP exception thrown: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7d33adb8-d923-48e3-ac03-d01f51f5c595 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Request method failure captured: May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 HTTP/1.1 May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOS6Q_TTV4tHUFfmwmwyomCXgRYCOvsQqBt1EO-Xt-CqZxs6183_rkfXPrZFhNP-C1GGMvnCcvHoTYoZCMvn5UtsXrbKpG5w1GSHu4wiCtUaCzGbcKOlOxcnc5JjbOi_6eFfpeIHgGTNLmIzopG19h35KXH5gJchqwdF2ARVe3WX0U May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:43:20.572575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a6eafe486fe4b5cadac660a921721c6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: a7a919d815074ed1aba725a56e198b47 May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'c36fbadf-da72-46ed-a55b-91f4233cc9a0'} May 19 16:43:20.574082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. (HTTP 404) (Request-ID: req-5ee1c92b-e97e-4c69-86e3-4f7751e693de) May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:20.575501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:20.577022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 16:43:20.578080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7d33adb8-d923-48e3-ac03-d01f51f5c595 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Returning 404 to user: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:43:20.579891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7d33adb8-d923-48e3-ac03-d01f51f5c595 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0" status: 404 len: 109 microversion: 2.1 time: 0.119002 May 19 16:43:20.584622 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 27/51] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:20 2022] GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 => generated 109 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:43:20.604123 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:20.604740 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:20.639898 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:20.643013 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:20.647123 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:20.647601 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:21.339129 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:21.361927 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-46e11a55-2b7c-47d5-b3de-88b2562a1341 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1280 microversion: 2.1 time: 0.772571 May 19 16:43:21.363984 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 28/52] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:20 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1280 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:21.380502 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a3277dbe-8867-4747-82d6-1c367f0b0b22 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f48981c90d0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:21.489095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-a3277dbe-8867-4747-82d6-1c367f0b0b22 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] HTTP exception thrown: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a3277dbe-8867-4747-82d6-1c367f0b0b22 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Request method failure captured: May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 HTTP/1.1 May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOS6Q_TTV4tHUFfmwmwyomCXgRYCOvsQqBt1EO-Xt-CqZxs6183_rkfXPrZFhNP-C1GGMvnCcvHoTYoZCMvn5UtsXrbKpG5w1GSHu4wiCtUaCzGbcKOlOxcnc5JjbOi_6eFfpeIHgGTNLmIzopG19h35KXH5gJchqwdF2ARVe3WX0U May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:43:21.493422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a6eafe486fe4b5cadac660a921721c6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: a7a919d815074ed1aba725a56e198b47 May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'c36fbadf-da72-46ed-a55b-91f4233cc9a0'} May 19 16:43:21.494679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. (HTTP 404) (Request-ID: req-e51bd1a0-b2cd-4e89-a8fd-cc7d8d0d0f65) May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:21.495421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 16:43:21.496636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 16:43:21.498398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:21.499439 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a3277dbe-8867-4747-82d6-1c367f0b0b22 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Returning 404 to user: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:43:21.500729 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a3277dbe-8867-4747-82d6-1c367f0b0b22 tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0" status: 404 len: 109 microversion: 2.1 time: 0.132044 May 19 16:43:21.511822 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 29/53] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:43:21 2022] DELETE /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 => generated 109 bytes in 147 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:43:21.520677 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:21.528588 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:21.591192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:21.599253 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:21.604033 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:21.606540 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:22.439857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:22.459925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-83886464-2a07-45f0-a6d4-e5d2cdfd6f65 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.944907 May 19 16:43:22.479651 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 30/54] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:21 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 966 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:22.499599 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-008583c0-fa2f-4908-917d-2042543a46ba tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Calling method '.version_select at 0x7f4898236160>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:22.585531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-008583c0-fa2f-4908-917d-2042543a46ba tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] HTTP exception thrown: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-008583c0-fa2f-4908-917d-2042543a46ba tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Request method failure captured: May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 HTTP/1.1 May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOS6Q_TTV4tHUFfmwmwyomCXgRYCOvsQqBt1EO-Xt-CqZxs6183_rkfXPrZFhNP-C1GGMvnCcvHoTYoZCMvn5UtsXrbKpG5w1GSHu4wiCtUaCzGbcKOlOxcnc5JjbOi_6eFfpeIHgGTNLmIzopG19h35KXH5gJchqwdF2ARVe3WX0U May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:43:22.588421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_5a6eafe486fe4b5cadac660a921721c6", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/5a6eafe486fe4b5cadac660a921721c6"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 5a6eafe486fe4b5cadac660a921721c6 May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-189074879 May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: a7a919d815074ed1aba725a56e198b47 May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesSnapshotsTestJSON-189074879-project May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'c36fbadf-da72-46ed-a55b-91f4233cc9a0'} May 19 16:43:22.590471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. (HTTP 404) (Request-ID: req-050ffecf-673d-426d-af62-e3ba8b614748) May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:22.591788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:43:22.594453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 16:43:22.596995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. May 19 16:43:22.597953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:43:22.602127 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-008583c0-fa2f-4908-917d-2042543a46ba tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] Returning 404 to user: Volume c36fbadf-da72-46ed-a55b-91f4233cc9a0 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:43:22.605568 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-008583c0-fa2f-4908-917d-2042543a46ba tempest-VolumesSnapshotsTestJSON-189074879 tempest-VolumesSnapshotsTestJSON-189074879-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0" status: 404 len: 109 microversion: 2.1 time: 0.121930 May 19 16:43:22.606399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 31/55] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:22 2022] GET /compute/v2.1/os-volumes/c36fbadf-da72-46ed-a55b-91f4233cc9a0 => generated 109 bytes in 126 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:43:22.621778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:22.622829 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:22.644902 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:22.645751 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:22.647397 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:22.648311 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:22.827462 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:43:22.828092 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:43:22.828686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:43:22.829807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:43:22.830399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:43:22.898056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:22.900919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:22.904282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:22.911981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:22.960094 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:22.979250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c2340156-5ef4-44c0-a028-076377ebbd23 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1280 microversion: 2.1 time: 0.370089 May 19 16:43:22.993302 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 32/56] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:22 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1280 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:23.083349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:43:23.111241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:43:23.205687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:43:23.215411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:43:23.389566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-10371c44-cc74-4034-9699-412ebf409353 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.907193 May 19 16:43:23.396200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 25/57] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:43:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 4915 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:43:23.406013 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-99c3a49d-677f-484c-8537-b07c9c8d1be8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:23.406647 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-99c3a49d-677f-484c-8537-b07c9c8d1be8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:23.481534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:23.482525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:23.498408 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:23.499214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:23.505271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:23.506145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:23.916350 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-99c3a49d-677f-484c-8537-b07c9c8d1be8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:23.941968 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-99c3a49d-677f-484c-8537-b07c9c8d1be8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1241 microversion: 2.1 time: 0.539765 May 19 16:43:23.943198 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 33/58] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:23 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1241 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:24.001524 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:24.003259 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:24.019874 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:24.020645 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:24.021763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:24.027916 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:24.229145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:24.242401 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c32200e9-fddf-461c-ac8d-98d21eee303e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1280 microversion: 2.1 time: 0.247465 May 19 16:43:24.246785 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 34/59] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:23 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1280 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:24.961494 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:24.962909 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:24.973180 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:24.974308 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:24.977796 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:24.978554 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:25.275830 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:25.284766 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2216f05b-53ad-45e3-9ef4-0cecf45cae65 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1245 microversion: 2.1 time: 0.327395 May 19 16:43:25.294256 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 35/60] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:24 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1245 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:25.319045 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:25.324061 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:25.357717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:25.365608 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:25.369517 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:25.372698 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:25.726412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:25.751626 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b91d2d6a-e982-4663-a9e7-b7f28cca228b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 2.273602 May 19 16:43:25.755834 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 26/61] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:23 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 2279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:26.102295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:26.112087 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ca61927e-444a-4d12-aba3-e39a2faf458a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1280 microversion: 2.1 time: 0.814891 May 19 16:43:26.122900 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 36/62] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:25 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1280 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:26.144521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-86a293c4-c050-45f1-83d8-a01e209b8dd7 req-159932fc-4d4b-43ae-bf0f-d48e81e27ae3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8308d660-3fe8-4074-9faf-3ba85cf16ac6", "tag": "a75788bb-8af6-425e-8f2f-8b760e4f3dee"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:26.232281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-86a293c4-c050-45f1-83d8-a01e209b8dd7 req-159932fc-4d4b-43ae-bf0f-d48e81e27ae3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:26.236636 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-86a293c4-c050-45f1-83d8-a01e209b8dd7 req-159932fc-4d4b-43ae-bf0f-d48e81e27ae3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:26.312405 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:26.313036 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:26.321425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:26.321880 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:26.322670 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:26.323108 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:26.332661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-86a293c4-c050-45f1-83d8-a01e209b8dd7 req-159932fc-4d4b-43ae-bf0f-d48e81e27ae3 service nova] Creating event network-changed:a75788bb-8af6-425e-8f2f-8b760e4f3dee for instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 on hv-cinder-84243 May 19 16:43:26.339615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-86a293c4-c050-45f1-83d8-a01e209b8dd7 req-159932fc-4d4b-43ae-bf0f-d48e81e27ae3 service nova] Acquired lock "compute-rpcapi-router" {{(pid=124122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 16:43:26.357678 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd33e4ef-6a40-4a31-b4ca-c9864242aa4a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:26.366648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd33e4ef-6a40-4a31-b4ca-c9864242aa4a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:26.375576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd33e4ef-6a40-4a31-b4ca-c9864242aa4a None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:26.390886 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd33e4ef-6a40-4a31-b4ca-c9864242aa4a None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:26.453495 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.compute.rpcapi [None req-cd33e4ef-6a40-4a31-b4ca-c9864242aa4a None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 16:43:26.468307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd33e4ef-6a40-4a31-b4ca-c9864242aa4a None None] Releasing lock "compute-rpcapi-router" {{(pid=124122) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 16:43:26.542468 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cd33e4ef-6a40-4a31-b4ca-c9864242aa4a None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.730021 May 19 16:43:26.543311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 27/63] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 732 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:43:26.778593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:26.779515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:26.803271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:26.804344 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:26.807932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:26.813998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:27.192897 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:27.208734 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-330d480f-ec65-4e00-b985-f0627b0bf1ab tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1293 microversion: 2.1 time: 0.900152 May 19 16:43:27.212190 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 37/64] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:26 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1293 bytes in 904 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:27.232672 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:27.233303 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:27.275221 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:27.275685 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:27.289385 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:27.289385 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:27.787964 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:27.806103 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d7635fb7-f1a4-4206-a187-a5005cc4dad2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1280 microversion: 2.1 time: 0.592759 May 19 16:43:27.810982 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 38/65] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:27 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1280 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:28.028345 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-43123716", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bf6144a-4dd4-4703-91b7-ee3e7d7d485e"}], "security_groups": [{"name": "tempest-securitygroup--320945607"}], "key_name": "tempest-keypair-1776713100", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:28.567851 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:28.586566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c7d98d14-d021-4a75-8e46-5153168d9148 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 1.807015 May 19 16:43:28.587611 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 28/66] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:26 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 1818 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:28.600255 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:28.604581 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:28.629883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:28.630722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:28.650182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:28.654296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:28.663743 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] validate_networks() for [('5bf6144a-4dd4-4703-91b7-ee3e7d7d485e', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:43:28.915184 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:28.927723 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-021bb87d-c4a7-4c57-ab65-b6492290ec81 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1299 microversion: 2.1 time: 0.337913 May 19 16:43:28.928393 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 29/67] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:28 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1299 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:28.976031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a9e3b36e-d5d9-450f-b0aa-18a683d2b6eb tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f48981c6b80>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:29.152233 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a9e3b36e-d5d9-450f-b0aa-18a683d2b6eb tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/31d4539e-6f26-4df6-ac0c-93c0f4a0a86c" status: 200 len: 351 microversion: 2.1 time: 0.208817 May 19 16:43:29.152830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 30/68] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:28 2022] GET /compute/v2.1/os-volumes/31d4539e-6f26-4df6-ac0c-93c0f4a0a86c => generated 351 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:29.163059 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:29.163873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:29.183571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:29.187466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:29.189757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:29.192583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:30.217251 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:30.788694 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:30.812368 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c589ddd4-657e-4594-bae2-b500dbc81742 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 1.658337 May 19 16:43:30.823601 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 31/69] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:29 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 1670 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:30.830214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:30.831017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:30.850959 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=71,nova_api:INSERT=10 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:30.853257 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:30.853934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:30.855310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:30.855978 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:31.521617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:31.534363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bc41a61e-d16c-4ff9-baa6-092896de489b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.709132 May 19 16:43:31.542536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 32/70] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:30 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:31.556471 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:31.557919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:31.573261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:31.573969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:31.575581 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:31.578454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:31.670064 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:43:31.670641 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:43:31.693421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:43:31.693421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:43:31.693421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:43:31.733293 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=17 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:31.739335 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:31.741943 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:31.743926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:31.744836 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:31.760974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=99 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:31.773037 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:43:31.780383 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for user 86b78ffb46894509bf8e81a154073885 and project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:43:31.799217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:43:31.805545 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:43:31.907357 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-aca1fe50-73f5-4b10-b069-8ab6f45b49df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 3.882529 May 19 16:43:31.910813 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 39/71] 10.222.0.36 () {62 vars in 1187 bytes} [Thu May 19 16:43:28 2022] POST /compute/v2.1/servers => generated 401 bytes in 3888 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) May 19 16:43:31.917962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a0811ea2-d659-40c8-9c58-7dabc217361a tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f4898236160>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:32.061557 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a0811ea2-d659-40c8-9c58-7dabc217361a tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/d98fd3a8-1baf-4370-908d-f218ed4cfcc4" status: 200 len: 351 microversion: 2.1 time: 0.149199 May 19 16:43:32.062922 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 40/72] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:31 2022] GET /compute/v2.1/os-volumes/d98fd3a8-1baf-4370-908d-f218ed4cfcc4 => generated 351 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:32.068736 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:32.069395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:32.098397 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:32.098811 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:32.105689 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:32.109214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:33.178653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=26 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:33.234345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:33.253487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-79c5d65e-909a-4846-9e8a-c51fbf58b4ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 1.707554 May 19 16:43:33.265865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 33/73] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:31 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 1722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:33.277486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:33.282199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:33.305385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:33.308542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:33.316414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:33.318454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:33.461324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:33.472829 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:33.474859 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:33.476838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d94976b3-5b3b-4550-b65f-8a41dcc1abe5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1284 microversion: 2.20 time: 0.209622 May 19 16:43:33.478187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 34/74] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:33 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1284 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:33.483759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:33.484681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:33.493018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:33.493621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:33.494485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:33.495031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:33.645103 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:33.657519 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-28c938b5-28a1-48f4-b629-ab66d9fc1c09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 1.592302 May 19 16:43:33.660969 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 41/75] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:32 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 1597 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:33.930386 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-699e53bd-2fc8-46a3-ac5f-e1e238bf7b55 req-b318be05-e186-40f6-93e8-16088a5f1c8f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e2d2c19b-7d96-4f1e-8f4a-7644b068da7f", "tag": "73f4e6f8-050c-4f74-9343-24340265e7f1"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:33.971135 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-699e53bd-2fc8-46a3-ac5f-e1e238bf7b55 req-b318be05-e186-40f6-93e8-16088a5f1c8f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:33.972468 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-699e53bd-2fc8-46a3-ac5f-e1e238bf7b55 req-b318be05-e186-40f6-93e8-16088a5f1c8f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:33.983302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:33.996081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-666aa7ad-88df-4c87-a6b9-c2bc81f6683b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.514510 May 19 16:43:33.996838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 35/76] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:33 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:34.018412 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-699e53bd-2fc8-46a3-ac5f-e1e238bf7b55 req-b318be05-e186-40f6-93e8-16088a5f1c8f service nova] Creating event network-changed:73f4e6f8-050c-4f74-9343-24340265e7f1 for instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f on hv-cinder-84243 May 19 16:43:34.018946 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-699e53bd-2fc8-46a3-ac5f-e1e238bf7b55 req-b318be05-e186-40f6-93e8-16088a5f1c8f service nova] Acquired lock "compute-rpcapi-router" {{(pid=124123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 19 16:43:34.020336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f30ffd3-7f95-4c49-8d06-b329c9e934a7 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.020856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f30ffd3-7f95-4c49-8d06-b329c9e934a7 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.021830 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f30ffd3-7f95-4c49-8d06-b329c9e934a7 None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.022336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f30ffd3-7f95-4c49-8d06-b329c9e934a7 None None] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.032718 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.compute.rpcapi [None req-3f30ffd3-7f95-4c49-8d06-b329c9e934a7 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 19 16:43:34.034279 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f30ffd3-7f95-4c49-8d06-b329c9e934a7 None None] Releasing lock "compute-rpcapi-router" {{(pid=124123) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 19 16:43:34.063036 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3f30ffd3-7f95-4c49-8d06-b329c9e934a7 None None] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.398984 May 19 16:43:34.070490 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 42/77] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:34.273200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:34.275141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:34.296526 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.297171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.299583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.300221 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.505409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:34.509235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:34.532857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.534750 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.535980 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.536863 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.665550 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:34.681985 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:34.684941 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:34.686757 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d0b56545-7189-45a5-80b3-09990f8a18ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1276 microversion: 2.20 time: 0.190328 May 19 16:43:34.687655 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 43/78] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:34 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1276 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:34.695562 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:34.696954 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:34.706506 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.707314 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.708458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.709599 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.787120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:34.811306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-81e44898-7665-44a9-9b90-3486f64a5039 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.543650 May 19 16:43:34.823918 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 36/79] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:34 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:34.876043 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-d15bcd2a-2b32-4e85-bb8f-22b43ea39912 req-7e04f685-ace1-425f-9b88-9f1d73feb9a9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ff377c-5ccd-40ca-9e51-6bde8aafab8c", "tag": "72dbf905-0954-48c4-90e4-39059b98309a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:34.898770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d15bcd2a-2b32-4e85-bb8f-22b43ea39912 req-7e04f685-ace1-425f-9b88-9f1d73feb9a9 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:34.899306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d15bcd2a-2b32-4e85-bb8f-22b43ea39912 req-7e04f685-ace1-425f-9b88-9f1d73feb9a9 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:34.935400 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-d15bcd2a-2b32-4e85-bb8f-22b43ea39912 req-7e04f685-ace1-425f-9b88-9f1d73feb9a9 service nova] Creating event network-changed:72dbf905-0954-48c4-90e4-39059b98309a for instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c on hv-cinder-84243 May 19 16:43:34.945377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-d15bcd2a-2b32-4e85-bb8f-22b43ea39912 req-7e04f685-ace1-425f-9b88-9f1d73feb9a9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073440 May 19 16:43:34.946541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 37/80] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:35.016909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:35.017786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:35.029506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:35.029964 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:35.030756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:35.031195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:35.163925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:35.180788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-12ee07c2-8301-4809-82d5-a79d7db14241 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.491176 May 19 16:43:35.192065 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 44/81] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:34 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:35.197923 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d8ae73c1-f722-480a-9b83-8cc4da2a6fee tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f489815bb80>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:35.303650 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d8ae73c1-f722-480a-9b83-8cc4da2a6fee tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/9b3871e4-1907-499c-82ab-56efb13c9f50" status: 200 len: 350 microversion: 2.1 time: 0.109866 May 19 16:43:35.305008 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 45/82] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:43:35 2022] GET /compute/v2.1/os-volumes/9b3871e4-1907-499c-82ab-56efb13c9f50 => generated 350 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:35.318488 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b0213d97-a6cf-41e5-883a-3e44d51fa1e2 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f48981c99d0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:35.471142 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b0213d97-a6cf-41e5-883a-3e44d51fa1e2 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.158454 May 19 16:43:35.471714 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 46/83] 10.222.0.36 () {58 vars in 1133 bytes} [Thu May 19 16:43:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:35.483627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-442db50b-352d-415d-b063-8f82fcaff9f0 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f4898223c10>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:35.503953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:35.515615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b47c262e-f432-4b70-a19d-3b683ff779c2 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.503388 May 19 16:43:35.516746 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 38/84] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:35 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:35.608246 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-442db50b-352d-415d-b063-8f82fcaff9f0 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.128260 May 19 16:43:35.615980 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 47/85] 10.222.0.36 () {58 vars in 1148 bytes} [Thu May 19 16:43:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:43:35.621462 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ed139772-6fa0-44c9-8138-7f1543a991bd tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f48981f6dc0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:35.708396 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:35.710169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:35.717605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:35.720585 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:35.722746 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:35.724035 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:35.879835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ed139772-6fa0-44c9-8138-7f1543a991bd tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.262240 May 19 16:43:35.887278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 39/86] 10.222.0.36 () {58 vars in 1133 bytes} [Thu May 19 16:43:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:35.887467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:35.888031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:35.903229 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:35.903846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:35.909896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:35.910659 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:36.083812 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:36.098915 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:36.103881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:36.107697 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-584bff6e-cc14-42fe-9c90-eab41287851d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1350 microversion: 2.20 time: 0.405760 May 19 16:43:36.121022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 48/87] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:35 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1350 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:43:36.129283 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d0dd8d6e-4e2a-4e7b-bd39-943e01382b55 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f489815bee0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:36.136721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:36.163961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4d2d4e19-ef28-4ff8-bf95-322648941e03 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.281141 May 19 16:43:36.174871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 40/88] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:35 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:36.186933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-fa2080a1-6abf-452d-8d4c-b2e65c3c725a req-8b02211d-ded5-4043-9660-59c99cf7ebe2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f47945f2-c715-4fc2-9759-55dc7bdd02de", "tag": "037a42bd-818d-415e-abbc-f96733de3dbd"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:36.207114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fa2080a1-6abf-452d-8d4c-b2e65c3c725a req-8b02211d-ded5-4043-9660-59c99cf7ebe2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:36.210020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fa2080a1-6abf-452d-8d4c-b2e65c3c725a req-8b02211d-ded5-4043-9660-59c99cf7ebe2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:36.239581 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d0dd8d6e-4e2a-4e7b-bd39-943e01382b55 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.116598 May 19 16:43:36.240778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 49/89] 10.222.0.36 () {58 vars in 1166 bytes} [Thu May 19 16:43:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:36.246751 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:36.248936 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:36.252893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-fa2080a1-6abf-452d-8d4c-b2e65c3c725a req-8b02211d-ded5-4043-9660-59c99cf7ebe2 service nova] Creating event network-changed:037a42bd-818d-415e-abbc-f96733de3dbd for instance f47945f2-c715-4fc2-9759-55dc7bdd02de on hv-cinder-84243 May 19 16:43:36.261231 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-fa2080a1-6abf-452d-8d4c-b2e65c3c725a req-8b02211d-ded5-4043-9660-59c99cf7ebe2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084187 May 19 16:43:36.262188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 41/90] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:36.264306 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:36.264847 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:36.267339 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:36.267777 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:36.269810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-db9d4be7-824a-46e0-834b-c7d685282c65 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f48981f6940>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:36.433032 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-db9d4be7-824a-46e0-834b-c7d685282c65 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.168677 May 19 16:43:36.433906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 42/91] 10.222.0.36 () {58 vars in 1169 bytes} [Thu May 19 16:43:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:36.447176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:36.454458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a78f6b9-b42d-4da2-b240-58c56dcfb0b7 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f48981be3a0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:36.525724 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:36.544118 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8767bd00-e79d-47c9-9b5d-744864d46d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.301916 May 19 16:43:36.544706 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 50/92] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:36 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:36.556822 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:36.557526 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:36.565734 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:36.567215 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:36.570503 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:36.570595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9a78f6b9-b42d-4da2-b240-58c56dcfb0b7 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.124192 May 19 16:43:36.570956 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 43/93] 10.222.0.36 () {58 vars in 1154 bytes} [Thu May 19 16:43:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:36.577869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:36.582917 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d691f5ce-ea45-4fd8-bd52-222ef95432fe tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f4898163550>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:36.729137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d691f5ce-ea45-4fd8-bd52-222ef95432fe tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.150939 May 19 16:43:36.729743 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 44/94] 10.222.0.36 () {58 vars in 1187 bytes} [Thu May 19 16:43:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:43:36.742014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-919e0640-a09c-4b4b-ba13-12e5899dbde5 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] Calling method '.version_select at 0x7f4898163430>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:36.850505 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:36.862751 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2e1d9e7b-9c4d-4308-82b5-d8e780493e62 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.316931 May 19 16:43:36.863347 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 51/95] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:36 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:37.059057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-919e0640-a09c-4b4b-ba13-12e5899dbde5 tempest-VolumesTestJSON-846073200 tempest-VolumesTestJSON-846073200-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.320625 May 19 16:43:37.060103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 45/96] 10.222.0.36 () {58 vars in 1154 bytes} [Thu May 19 16:43:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:37.127281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:37.128668 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:37.142256 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.145686 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:37.148656 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.150958 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:37.186341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:37.187267 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:37.207206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.209644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:37.213450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.215005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:37.291564 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:37.300882 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:37.302874 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:37.304212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4ab09b1d-4d0e-4eb5-b0d9-b4de300a5ad5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1350 microversion: 2.20 time: 0.181308 May 19 16:43:37.304729 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 52/97] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:37 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1350 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:37.529804 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:37.538899 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fb8c0d3e-7a13-4b07-82ed-6b20f7f318a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.359206 May 19 16:43:37.540531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 46/98] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:37 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:37.560698 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:37.561954 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:37.570347 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.570798 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:37.571957 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.572704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:37.778437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:37.788854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-56e67ef6-99c6-4938-a007-aab31bb75b53 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.231853 May 19 16:43:37.789626 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 53/99] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:37 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:37.882700 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:37.883338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:37.890582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.891228 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:37.892176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:37.892876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:38.327611 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:38.330379 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:38.331517 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:38.346570 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e4e9a19b-57ac-4d32-aa8b-87ff1e91eb7b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.469813 May 19 16:43:38.348642 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:38.352008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 47/100] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:37 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:38.352681 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:38.353930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:38.356931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:38.464006 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:38.473688 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:38.475241 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:38.476523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-df1043dc-454f-4514-b81b-a05193f1ee2b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1338 microversion: 2.20 time: 0.157116 May 19 16:43:38.477122 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 54/101] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:38 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1338 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:43:38.557740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:38.558785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:38.566325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:38.567109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:38.568760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:38.569431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:38.808634 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:38.810366 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:38.816399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:38.816931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:38.817842 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:38.818444 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:39.030536 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:39.036070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:39.039095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f3649df9-78bd-493f-b60b-51170738e96e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.236355 May 19 16:43:39.048881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 55/102] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:38 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:39.049288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e86d8e55-ba8b-4501-9521-79d873227a0d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.495752 May 19 16:43:39.049898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 48/103] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:38 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:39.368343 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:39.369168 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:39.379732 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:39.380208 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:39.382454 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:39.383545 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:39.498033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:39.498654 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:39.510973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:39.511438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:39.512308 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:39.512648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:39.530609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=99 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:39.612928 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:39.628974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-94ec58c6-9686-4fdd-8dda-be52f8fa6f32 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.266216 May 19 16:43:39.629597 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 56/104] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:39 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:39.713537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:39.730422 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:39.733063 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:39.735667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7398f6e6-1815-466b-ad12-3ce65dce6409 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1338 microversion: 2.20 time: 0.243930 May 19 16:43:39.736579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 49/105] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:39 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1338 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:43:40.067308 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:40.069197 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:40.070505 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:40.071403 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:40.088249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.089016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.090244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.090838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.095567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.099190 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.100113 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.100550 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.430872 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:40.439426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dbb72e6c-e434-4dc7-bc63-a2946e792bc8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.386966 May 19 16:43:40.449264 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 57/106] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:40 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:40.647478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:40.648669 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:40.656796 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.657870 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.659898 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.660537 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.674813 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:40.691412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-538105a0-ec7f-4f4b-a72f-e787b83e6019 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.627919 May 19 16:43:40.692988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 50/107] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:40 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 631 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:40.763765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:40.764811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:40.775610 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.776428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.777861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:40.780398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:40.871219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:40.882219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5dc5cdab-b894-4b9b-9217-972536a9586e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.238447 May 19 16:43:40.883447 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 58/108] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:40 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:40.920455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:40.941283 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:40.942734 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:40.947896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b8f87d5a-6ba6-4fa9-b537-207574b82d74 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1338 microversion: 2.20 time: 0.192802 May 19 16:43:40.959242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 51/109] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:40 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1338 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:43:41.457418 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:41.458540 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:41.466435 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.467643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:41.468426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.470848 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:41.678696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:41.686744 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-32b77113-8280-430c-8e7f-7c3a48211642 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.233739 May 19 16:43:41.689550 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 59/110] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:41 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:41.711702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:41.712426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:41.720832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.721585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:41.722527 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.723286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:41.901413 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:41.902482 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:41.906504 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=5 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:41.914307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:41.921277 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.921738 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:41.926126 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.931159 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:41.935641 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-19834661-bacd-466d-8f11-8d83d080e273 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.225617 May 19 16:43:41.941344 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 52/111] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:41 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:41.968348 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:41.969104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:41.983347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.983956 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:41.985439 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:41.987611 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:42.161502 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:42.171765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:42.173854 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:42.176434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-61d4ff53-d051-4493-b4d5-eb783164adce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.213715 May 19 16:43:42.190002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 53/112] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:41 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:43:42.352851 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:42.364753 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-85d9f47c-6a1a-4327-af5d-b74fa3d2681c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.468844 May 19 16:43:42.366681 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 60/113] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:41 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:42.708365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:42.709970 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:42.731213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:42.732472 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:42.734061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:42.735528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:42.961218 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:42.961848 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:42.971753 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:42.972407 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:42.973362 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:42.973926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:43.011667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:43.022434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-158a5152-1c4c-4b88-881a-9816712ea809 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.318750 May 19 16:43:43.032296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 54/114] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:42 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:43.148191 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:43.152175 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:43.160725 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cfe18581-ec46-4176-b140-069b6c75bcff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.208488 May 19 16:43:43.171195 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 61/115] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:42 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:43.195882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:43.196615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:43.208508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:43.209769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:43.210786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:43.211491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:43.472574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:43.489072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:43.499343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:43.502454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e79fe1e2-cd05-4b46-887b-5c29c38ca224 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.312012 May 19 16:43:43.504286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 55/116] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:43 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:43.515972 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:43.516971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:43.528580 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:43.529479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:43.531147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:43.532798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:43.720418 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-fdbaf140-0e58-4195-90ac-2638c7d44cf1 req-8b7a4df9-c1a0-4bfd-b9e4-43eed5856293 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8308d660-3fe8-4074-9faf-3ba85cf16ac6", "name": "network-vif-plugged", "status": "completed", "tag": "a75788bb-8af6-425e-8f2f-8b760e4f3dee"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:43.732206 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-fdbaf140-0e58-4195-90ac-2638c7d44cf1 req-8b7a4df9-c1a0-4bfd-b9e4-43eed5856293 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:43.735925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-fdbaf140-0e58-4195-90ac-2638c7d44cf1 req-8b7a4df9-c1a0-4bfd-b9e4-43eed5856293 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:43.752363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:43.765278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6f4eaacd-a4a7-4ff2-939e-b2ce0bccf6f9 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.254791 May 19 16:43:43.765471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-fdbaf140-0e58-4195-90ac-2638c7d44cf1 req-8b7a4df9-c1a0-4bfd-b9e4-43eed5856293 service nova] Creating event network-vif-plugged:a75788bb-8af6-425e-8f2f-8b760e4f3dee for instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 on hv-cinder-84243 May 19 16:43:43.766171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 56/117] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:43 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:43.772475 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-fdbaf140-0e58-4195-90ac-2638c7d44cf1 req-8b7a4df9-c1a0-4bfd-b9e4-43eed5856293 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.493850 May 19 16:43:43.778342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 62/118] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:43.889008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-6496c498-e161-4beb-b75e-3ffe3968dc46 req-221f3476-f7e3-4378-9c8b-3ec753b02c87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a6d6a59-35a3-46b0-a92a-a3ae729071b7", "tag": "5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:43.898535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6496c498-e161-4beb-b75e-3ffe3968dc46 req-221f3476-f7e3-4378-9c8b-3ec753b02c87 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:43.899173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6496c498-e161-4beb-b75e-3ffe3968dc46 req-221f3476-f7e3-4378-9c8b-3ec753b02c87 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:43.920684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-6496c498-e161-4beb-b75e-3ffe3968dc46 req-221f3476-f7e3-4378-9c8b-3ec753b02c87 service nova] Creating event network-changed:5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc for instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 on hv-cinder-84243 May 19 16:43:43.932841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-6496c498-e161-4beb-b75e-3ffe3968dc46 req-221f3476-f7e3-4378-9c8b-3ec753b02c87 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048861 May 19 16:43:43.936284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 57/119] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:44.040235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:44.041824 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:44.043929 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:44.051130 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.051704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:44.052595 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.053124 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:44.180919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:44.181665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:44.195680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.196153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:44.197922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.198371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:44.204731 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:44.213433 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e0e855fb-1d01-4d82-83b4-9a1170ac9d54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.177662 May 19 16:43:44.214003 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 63/120] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:44 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:44.371080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:44.380286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e2dc316a-6ce4-468b-81d6-8b89c9d394f1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.203638 May 19 16:43:44.380369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 58/121] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:44 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:44.524981 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:44.524981 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:44.534748 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.535429 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:44.536826 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.545374 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:44.731803 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:44.741347 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:44.742857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:44.744097 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5dbde031-f7c1-45ca-8c01-4eea52b84a79 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.226290 May 19 16:43:44.744819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 64/122] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:44 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:44.781942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:44.782757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:44.789251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.789785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:44.790632 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:44.791143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:45.231431 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:45.232930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:45.248694 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:45.249403 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:45.249812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:45.251479 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:45.252083 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:45.269576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f701f6f6-c5d1-493d-bf49-256ce2944138 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.490784 May 19 16:43:45.280497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 59/123] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:44 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:45.396920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:45.397668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:45.416063 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:45.420354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:45.421559 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:45.424301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:45.858974 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:45.870661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2607ba6b-1898-4f33-9d23-4154443ac16b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.478292 May 19 16:43:45.885465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 60/124] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:45 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 494 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:45.907395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:45.908853 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:45.921545 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:45.932792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:45.935772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:45.936702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:46.013559 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:46.025919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c98378a4-c4e4-4e71-9e98-f8ee0810c368 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.798479 May 19 16:43:46.031134 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 65/125] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:45 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 805 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:46.035969 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-04f91389-8818-4c18-9ecd-567700f911e0 req-864c64b4-5266-4e6e-ab50-f726f9bf6f20 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d2c19b-7d96-4f1e-8f4a-7644b068da7f", "name": "network-vif-plugged", "status": "completed", "tag": "73f4e6f8-050c-4f74-9343-24340265e7f1"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:46.054616 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-04f91389-8818-4c18-9ecd-567700f911e0 req-864c64b4-5266-4e6e-ab50-f726f9bf6f20 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:46.055054 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-04f91389-8818-4c18-9ecd-567700f911e0 req-864c64b4-5266-4e6e-ab50-f726f9bf6f20 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:46.081708 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-04f91389-8818-4c18-9ecd-567700f911e0 req-864c64b4-5266-4e6e-ab50-f726f9bf6f20 service nova] Creating event network-vif-plugged:73f4e6f8-050c-4f74-9343-24340265e7f1 for instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f on hv-cinder-84243 May 19 16:43:46.094579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-04f91389-8818-4c18-9ecd-567700f911e0 req-864c64b4-5266-4e6e-ab50-f726f9bf6f20 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061369 May 19 16:43:46.097047 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 66/126] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:46.292869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:46.293616 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:46.313071 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:46.313556 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:46.314344 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:46.314779 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:46.714074 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:46.724193 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fc716ed8-2183-410e-a5f4-a06a3e785fe1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.438056 May 19 16:43:46.727499 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 67/127] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:46 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:46.768867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:46.780028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:46.791173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:46.792578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-751eb795-8230-468c-b07d-211e74f5bbd3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.896888 May 19 16:43:46.793723 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 61/128] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:45 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 907 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:46.891841 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:46.892539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:46.906032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:46.906669 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:46.907525 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:46.908152 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:47.047385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:47.048205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:47.062253 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:47.063876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:47.064739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:47.065193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:47.300841 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:47.308508 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-12c6d02c-a57e-422f-a1a3-7e6189769822 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.421423 May 19 16:43:47.312132 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 68/129] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:46 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:47.377490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:47.388408 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-719a7bf2-5a46-4a0d-b792-29900044dd05 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.344689 May 19 16:43:47.393434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 62/130] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:47 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:47.744480 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:47.745272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:47.754005 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:47.754447 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:47.755295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:47.755786 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:47.811728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:47.813009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:47.822936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:47.823679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:47.824646 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:47.827538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:47.992879 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:48.002477 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:48.007246 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b608d74b-af69-427e-a9e3-753de79a919d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1314 microversion: 2.1 time: 0.268606 May 19 16:43:48.008540 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 69/131] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:47 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:48.014019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:48.016550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:48.030091 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4ab8e85d-8214-47a0-9f1a-fe9d129e8b8b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.221926 May 19 16:43:48.032008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 63/132] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:47 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:48.112911 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-517e45ab-064d-4abb-a5d0-f1200eef5bd1 req-3ea7e78c-97f9-409a-80ad-7801c5c9e414 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47945f2-c715-4fc2-9759-55dc7bdd02de", "name": "network-vif-plugged", "status": "completed", "tag": "037a42bd-818d-415e-abbc-f96733de3dbd"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:48.121354 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-517e45ab-064d-4abb-a5d0-f1200eef5bd1 req-3ea7e78c-97f9-409a-80ad-7801c5c9e414 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:48.122041 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-517e45ab-064d-4abb-a5d0-f1200eef5bd1 req-3ea7e78c-97f9-409a-80ad-7801c5c9e414 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:48.137653 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-517e45ab-064d-4abb-a5d0-f1200eef5bd1 req-3ea7e78c-97f9-409a-80ad-7801c5c9e414 service nova] Creating event network-vif-plugged:037a42bd-818d-415e-abbc-f96733de3dbd for instance f47945f2-c715-4fc2-9759-55dc7bdd02de on hv-cinder-84243 May 19 16:43:48.145195 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-517e45ab-064d-4abb-a5d0-f1200eef5bd1 req-3ea7e78c-97f9-409a-80ad-7801c5c9e414 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036772 May 19 16:43:48.146186 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 70/133] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:48.328377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:48.329024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:48.335020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:48.335471 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:48.336248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:48.336674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:48.409511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:48.410118 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:48.419209 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:48.419896 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:48.421235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:48.421235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:48.539510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:48.562034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-68430a00-eaf7-421e-8452-14b6ee9edc9a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.237662 May 19 16:43:48.564717 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 64/134] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:48 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:48.585481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:48.595554 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ab95f65d-3ad9-4c28-abb7-dee1311dce45 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.190835 May 19 16:43:48.597494 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 71/135] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:48 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:49.028839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:49.029491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:49.037302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.037772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.038566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.039004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.048519 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:49.049265 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:49.056756 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.057245 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.058033 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.058474 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.288320 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:49.302318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-799da72d-e22e-4750-9292-fdd406ec385a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1500 microversion: 2.1 time: 0.277537 May 19 16:43:49.306457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 65/136] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:49 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1500 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:49.508520 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:49.517714 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:49.519233 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:49.520332 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5c179e42-1b23-4921-9740-a9c4fc89ddfb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.475716 May 19 16:43:49.521915 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 72/137] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:49 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:43:49.583950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:49.584592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:49.591145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.591608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.592534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.593199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.613855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:49.616319 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:49.617049 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:49.629955 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.631367 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.634312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:49.634764 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:49.771928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:49.782008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-244c8333-3030-466d-a421-f64edd22a5f0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.203195 May 19 16:43:49.787129 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 66/138] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:49 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:49.897503 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:49.905449 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7bedebc8-62c9-44da-a4c5-56cfbf9d7829 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.296513 May 19 16:43:49.908418 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 73/139] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:49 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:50.174177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-9ba2f7bd-18be-4040-9751-2e5c69e0e37f req-e3af4c38-71f3-475c-ab69-2dae3054ed4c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ff377c-5ccd-40ca-9e51-6bde8aafab8c", "name": "network-vif-plugged", "status": "completed", "tag": "72dbf905-0954-48c4-90e4-39059b98309a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:50.182684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-9ba2f7bd-18be-4040-9751-2e5c69e0e37f req-e3af4c38-71f3-475c-ab69-2dae3054ed4c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:50.183130 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-9ba2f7bd-18be-4040-9751-2e5c69e0e37f req-e3af4c38-71f3-475c-ab69-2dae3054ed4c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:50.194820 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-9ba2f7bd-18be-4040-9751-2e5c69e0e37f req-e3af4c38-71f3-475c-ab69-2dae3054ed4c service nova] Creating event network-vif-plugged:72dbf905-0954-48c4-90e4-39059b98309a for instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c on hv-cinder-84243 May 19 16:43:50.202145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-9ba2f7bd-18be-4040-9751-2e5c69e0e37f req-e3af4c38-71f3-475c-ab69-2dae3054ed4c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032666 May 19 16:43:50.202876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 67/140] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:43:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:50.540807 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:50.542521 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:50.550350 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:50.551080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:50.551854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:50.552366 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:50.706091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:50.716345 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:50.718698 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:50.720962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e10fa12c-da25-4977-9f2a-84cf133090a2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.185751 May 19 16:43:50.722304 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 74/141] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:50 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:50.804760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:50.805558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:50.812999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:50.813640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:50.814479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:50.814956 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:50.924272 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-06b49f8f-0814-42e6-8ff0-494f083e49f1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "abbb488c-b015-42a3-af3e-a9fc43dd3220"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:43:50.925657 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-06b49f8f-0814-42e6-8ff0-494f083e49f1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:50.934336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06b49f8f-0814-42e6-8ff0-494f083e49f1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:50.935181 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06b49f8f-0814-42e6-8ff0-494f083e49f1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:50.937558 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06b49f8f-0814-42e6-8ff0-494f083e49f1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:50.938423 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-06b49f8f-0814-42e6-8ff0-494f083e49f1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:50.995708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:51.005979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1965b084-8625-4433-8952-46006c149553 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.205493 May 19 16:43:51.016814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 68/142] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:50 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:51.023210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:51.024366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:51.032606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:51.033382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:51.034472 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:51.035757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:51.190256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:51.198811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2077c412-c77b-4693-a4e9-3b1c014a2133 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.180100 May 19 16:43:51.199770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 69/143] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:51 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:51.739449 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:51.740059 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:51.746307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:51.747146 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:51.748069 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:51.748815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:51.940043 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:51.959239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:51.960758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:51.970311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5efd5b36-2703-481d-bbaf-6ddca9e78a5a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.234439 May 19 16:43:51.971405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 70/144] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:51 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:43:52.026151 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:52.027164 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:52.037943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:52.038578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:52.039319 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:52.039687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:52.278053 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-06b49f8f-0814-42e6-8ff0-494f083e49f1 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "POST /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.360364 May 19 16:43:52.293371 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 75/145] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:43:50 2022] POST /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6/os-volume_attachments => generated 194 bytes in 1378 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:52.307969 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:52.310173 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:52.323567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:52.324527 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:52.325811 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:52.326829 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:52.465566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:52.475717 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3c06ed7f-2d05-4d34-9db4-d0a92a4ee2c8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.453757 May 19 16:43:52.480274 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 71/146] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:52 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:52.609879 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:52.622284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c7c6f53d-64d7-4332-97af-a841966268c3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.326537 May 19 16:43:52.623452 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 76/147] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:52 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:52.989219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:52.989830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:52.996748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:52.997694 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:52.998664 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:52.999293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:53.147423 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:53.155496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:53.157060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:53.158204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cc1f8d05-0ad5-41d6-9e46-a0e65c37e04a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.172863 May 19 16:43:53.158936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 72/148] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:52 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:53.496747 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:53.497407 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:53.505316 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:53.505774 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:53.506811 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:53.507307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:53.639974 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:53.641716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:53.648403 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:53.649211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:53.650109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:53.650651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:53.657409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:53.665328 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d33c0fae-3f4b-4625-8a5e-f0393b42c554 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.173124 May 19 16:43:53.665901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 77/149] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:53 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:53.814357 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:53.823888 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e283aff8-06fc-4d26-ae83-da58ee2f88ab tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.187904 May 19 16:43:53.824681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 73/150] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:53 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:54.180571 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:54.180571 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:54.185430 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:54.186080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:54.189266 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:54.190556 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:54.347080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:54.355558 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:54.357058 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:54.358209 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3039a3fd-82f7-4a64-b049-50b76fd2b830 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.184594 May 19 16:43:54.369022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 78/151] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:54 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:54.682505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:54.683402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:54.690132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:54.690565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:54.691600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:54.692038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:54.840430 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:54.846341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:54.848476 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:54.849382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a9c7735b-5b2c-4e3d-bfab-db7012a5c7f8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.171040 May 19 16:43:54.850046 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 74/152] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:54 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:54.856735 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:54.857962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:54.858930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:54.859957 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:54.865325 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:43:55.151193 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:55.159993 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8692e5be-451a-484c-99c3-ce544d3447c7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.319475 May 19 16:43:55.160565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 79/153] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:54 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:55.375878 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:55.376670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:55.383341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:55.384066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:55.385060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:55.385598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:55.572357 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:55.581296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:55.583065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:55.584353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e149ef4e-29b6-4e19-b454-0190cf732a34 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.212426 May 19 16:43:55.595539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 75/154] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:55 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:55.866846 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:55.867343 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:55.874179 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:55.874658 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:55.875423 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:55.875868 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:56.014488 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:56.027030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d7a67ab3-71fa-416b-8fb6-112eccbb7107 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.161909 May 19 16:43:56.027030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 80/155] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:55 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:56.177006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:56.177852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:56.184011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:56.184547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:56.185420 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:56.185929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:56.394558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:56.403763 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-88155d37-9a61-4e3d-95d5-5a7dbca1dac0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.229984 May 19 16:43:56.403938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 76/156] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:56 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:56.605416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:56.607681 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:56.623351 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:56.623950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:56.624982 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:56.625252 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:56.779941 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:56.791382 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:56.792966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:56.794240 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-de891603-ddc7-4260-a91e-d446c3549db7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.195943 May 19 16:43:56.794857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 81/157] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:56 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:57.042012 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:57.042656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:57.049030 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:57.049514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:57.050367 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:57.050809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:57.185615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:57.193085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6d2fbb04-0e7d-411c-b6a7-fc5d8bd6c89e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.155035 May 19 16:43:57.193675 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 77/158] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:57 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:43:57.419939 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:57.420655 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:57.427861 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:57.428309 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:57.429072 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:57.429543 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:57.569419 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:57.578748 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e3e8950f-924b-4669-a37b-49830f09f0c0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.162058 May 19 16:43:57.579665 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 82/159] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:57 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:57.811587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:57.812202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:57.818619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:57.819159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:57.819963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:57.820402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:57.983927 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:58.001605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:58.003711 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:58.005628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-57adf17e-9f45-470b-9a19-751dbf79ecfd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.197819 May 19 16:43:58.013206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 78/160] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:57 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:58.211723 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:58.211723 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:58.216317 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:58.216767 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:58.217559 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:58.218001 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:58.393201 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:58.400885 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-05d50af4-882e-47b9-94a7-f0f8b8c5a172 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1367 microversion: 2.1 time: 0.194857 May 19 16:43:58.401523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 83/161] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:58 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:58.595581 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:58.596187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:58.602291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:58.602769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:58.603522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:58.603967 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:58.741668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:58.749167 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-17aacbaa-c477-4425-a31e-300db057f91f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.157384 May 19 16:43:58.750593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 79/162] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:58 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:59.030195 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:59.032003 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:59.043274 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.044220 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:59.045255 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.045835 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:59.224000 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:59.233494 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:59.235855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:59.237080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b1af09df-4814-457c-9c41-922bbda51fb0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.213581 May 19 16:43:59.237753 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 84/163] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:43:59 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:43:59.419832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:59.420771 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:59.430612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.432139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:59.432339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.433295 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:59.579228 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:43:59.590501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-85e6afbb-8d42-47ed-918a-65555d623169 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1556 microversion: 2.1 time: 0.175512 May 19 16:43:59.591392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 80/164] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:59 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1556 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:43:59.612386 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e02f5817-1d68-4a5c-9e4c-35ee24c99d05 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:59.612906 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e02f5817-1d68-4a5c-9e4c-35ee24c99d05 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:59.619770 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e02f5817-1d68-4a5c-9e4c-35ee24c99d05 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.620658 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e02f5817-1d68-4a5c-9e4c-35ee24c99d05 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:59.621467 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e02f5817-1d68-4a5c-9e4c-35ee24c99d05 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.621907 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e02f5817-1d68-4a5c-9e4c-35ee24c99d05 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:59.722966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e02f5817-1d68-4a5c-9e4c-35ee24c99d05 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.118268 May 19 16:43:59.723950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 85/165] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:43:59 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-interface => generated 284 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:43:59.768534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:43:59.769177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:43:59.779321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.779778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:43:59.780562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:43:59.781041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:00.009978 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:00.019013 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d00cf86b-be24-4cd3-b8c8-42e1c1178e3b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.254742 May 19 16:44:00.028954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 81/166] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:43:59 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:00.255510 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:00.256398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:00.258890 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:00.265627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:00.266088 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:00.266939 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:00.267408 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:00.621389 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:00.648605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:00.650385 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:00.651881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3ab785ba-6b52-41f9-89f3-ad205da44673 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.400287 May 19 16:44:00.668115 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 86/167] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:00 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:01.036005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:01.036600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:01.038837 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=90 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:01.044558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:01.045206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:01.046212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:01.047227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:01.224378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:01.232385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-daf5793c-6ddb-4007-8084-6ee6cee5130a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.200361 May 19 16:44:01.242995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 82/168] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:01 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:01.443701 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-d513ae25-02f3-4bc9-8d55-17a3c7110dfa req-e4c1e0d2-1b42-4d40-83bc-6a992cee5a9e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4ff377c-5ccd-40ca-9e51-6bde8aafab8c", "tag": "72dbf905-0954-48c4-90e4-39059b98309a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:01.459064 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d513ae25-02f3-4bc9-8d55-17a3c7110dfa req-e4c1e0d2-1b42-4d40-83bc-6a992cee5a9e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:01.460868 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d513ae25-02f3-4bc9-8d55-17a3c7110dfa req-e4c1e0d2-1b42-4d40-83bc-6a992cee5a9e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:01.478855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-d513ae25-02f3-4bc9-8d55-17a3c7110dfa req-e4c1e0d2-1b42-4d40-83bc-6a992cee5a9e service nova] Creating event network-changed:72dbf905-0954-48c4-90e4-39059b98309a for instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c on hv-cinder-84243 May 19 16:44:01.487723 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-d513ae25-02f3-4bc9-8d55-17a3c7110dfa req-e4c1e0d2-1b42-4d40-83bc-6a992cee5a9e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052792 May 19 16:44:01.489506 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 87/169] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:44:01.520398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-c6613817-87e8-4cbb-abaa-734e3b0204be req-83a46eda-e4dd-432e-b6c3-aa0ef6d60874 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6d6a59-35a3-46b0-a92a-a3ae729071b7", "name": "network-vif-plugged", "status": "completed", "tag": "5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:01.536823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c6613817-87e8-4cbb-abaa-734e3b0204be req-83a46eda-e4dd-432e-b6c3-aa0ef6d60874 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:01.537856 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-c6613817-87e8-4cbb-abaa-734e3b0204be req-83a46eda-e4dd-432e-b6c3-aa0ef6d60874 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:01.565920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-c6613817-87e8-4cbb-abaa-734e3b0204be req-83a46eda-e4dd-432e-b6c3-aa0ef6d60874 service nova] Creating event network-vif-plugged:5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc for instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 on hv-cinder-84243 May 19 16:44:01.571982 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-c6613817-87e8-4cbb-abaa-734e3b0204be req-83a46eda-e4dd-432e-b6c3-aa0ef6d60874 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055683 May 19 16:44:01.573280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 83/170] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:44:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:44:01.674790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:01.675500 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:01.683635 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:01.684117 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:01.685080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:01.685690 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:01.865130 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:01.873501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:01.875810 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:01.877257 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-45378cf8-644c-4bba-86b6-234c039805e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.206702 May 19 16:44:01.878002 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 88/171] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:01 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:02.254323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:02.256148 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:02.267833 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:02.268619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:02.269929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:02.270615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:02.293757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:02.537728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:02.548159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-13cb303f-782f-4bfc-bbb7-898d3bf51223 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1322 microversion: 2.1 time: 0.300350 May 19 16:44:02.548863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 84/172] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:02 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1322 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:02.901641 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:02.902257 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:02.910245 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:02.910884 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:02.911932 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:02.912522 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:03.122880 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:03.136237 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:03.138248 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:03.139511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b469eeb9-9ed2-4987-8384-45727bec1ea6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.243131 May 19 16:44:03.152308 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 89/173] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:02 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:03.564817 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:03.565516 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:03.571748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:03.572419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:03.573135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:03.573606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:03.704640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:03.712863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-033ca7a9-9189-45bb-a491-030d07e8e2a9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1515 microversion: 2.1 time: 0.152100 May 19 16:44:03.714226 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 85/174] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:03 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1515 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:03.731124 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:03.732141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:03.738709 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:03.739159 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:03.739920 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:03.740367 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:03.767388 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lazy-loading 'flavor' on Instance uuid f47945f2-c715-4fc2-9759-55dc7bdd02de {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:44:03.903283 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0a51d80b-f7c8-4ed5-a477-2464c65f12ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de/action" status: 200 len: 32 microversion: 2.1 time: 0.176031 May 19 16:44:03.908760 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 90/175] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:44:03 2022] POST /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de/action => generated 32 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 16:44:03.915576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:03.916196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:03.923213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:03.923670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:03.924447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:03.924883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:04.069703 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:04.077101 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ce8ba506-ca77-4b31-8e75-610ce978cc02 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.166450 May 19 16:44:04.078209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 86/176] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:03 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:04.160041 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:04.160731 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:04.168123 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:04.168567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:04.169349 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:04.169903 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:04.307640 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:04.316523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:04.318100 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:04.319216 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-828e5506-51da-4f08-acb4-2faaac06b88f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.163266 May 19 16:44:04.319724 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 91/177] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:04 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:05.095260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:05.095904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:05.101949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:05.102394 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:05.103156 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:05.103589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:05.234780 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:05.242269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-201a9b08-0934-493f-acef-005ea2093f09 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.151493 May 19 16:44:05.243031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 87/178] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:05 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:05.337920 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:05.338534 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:05.345650 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:05.346100 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:05.346863 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:05.347296 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:05.475619 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:05.483425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:05.484923 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:05.486040 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1284b38c-93d9-4045-9b25-41701cc61b47 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.152047 May 19 16:44:05.486586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 92/179] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:05 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:06.259729 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:06.260349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:06.267270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:06.267721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:06.268494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:06.268924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:06.414231 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:06.421785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-24c6f36b-fb60-45aa-b3f0-e0386ba09ca6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.166167 May 19 16:44:06.422350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 88/180] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:06 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:06.504301 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:06.504911 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:06.511691 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:06.512149 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:06.512916 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:06.513384 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:06.641896 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:06.649790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:06.651284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:06.652375 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4c2f209a-e35e-4a02-9aca-76039a72a1c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.151967 May 19 16:44:06.652950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 93/181] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:06 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:07.438665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:07.439272 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:07.445511 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:07.445966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:07.446736 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:07.447169 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:07.591985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:07.600226 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-161e21ab-f3ea-40b0-85a8-7b051a3182bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.165338 May 19 16:44:07.600809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 89/182] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:07 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:07.671023 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:07.671620 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:07.678146 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:07.678594 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:07.679351 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:07.679777 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:07.856196 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:07.858552 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:07.867753 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:07.869891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:07.871188 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8c6c9a5a-a41c-4673-a2a1-dadf114ddd5f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.204029 May 19 16:44:07.871950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 94/183] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:07 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:08.617222 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:08.618458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:08.624858 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:08.625660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:08.626656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:08.627306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:08.816940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:08.824813 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1335b240-6e4c-45ff-ba45-7211416175db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.211359 May 19 16:44:08.825417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 90/184] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:08 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:08.889803 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:08.890411 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:08.898209 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:08.898651 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:08.899415 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:08.899843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:09.032761 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:09.040568 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:09.042091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:09.043212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e36dabea-37a6-4e61-89e5-04eeeaac3a2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1405 microversion: 2.20 time: 0.157342 May 19 16:44:09.043768 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 95/185] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:08 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1405 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:09.841834 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:09.842450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:09.849200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:09.849650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:09.850438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:09.850881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:10.023921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:10.032235 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bb0dac5c-37e1-4ac9-b4e6-0f106249beea tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.194185 May 19 16:44:10.032966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 91/186] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:09 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:10.061301 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:10.062488 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:10.070475 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:10.071085 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:10.071991 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:10.072433 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:10.215868 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:10.224338 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:10.225884 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:10.227039 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-332832c1-9e10-4183-b1f1-c8ae4c8cc55b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1597 microversion: 2.20 time: 0.169815 May 19 16:44:10.227598 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 96/187] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:44:10 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1597 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:44:10.246877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a715d200-a66e-4868-9e47-560679da51fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:10.247411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a715d200-a66e-4868-9e47-560679da51fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:10.256311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a715d200-a66e-4868-9e47-560679da51fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:10.256535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a715d200-a66e-4868-9e47-560679da51fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:10.257530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a715d200-a66e-4868-9e47-560679da51fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:10.257973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a715d200-a66e-4868-9e47-560679da51fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:10.383141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a715d200-a66e-4868-9e47-560679da51fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.140611 May 19 16:44:10.383714 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 92/188] 10.222.0.36 () {60 vars in 1315 bytes} [Thu May 19 16:44:10 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-interface => generated 285 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:44:11.052112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:11.052859 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:11.062324 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:11.062909 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:11.063637 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:11.064067 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:11.326889 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:11.335112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d29411da-4c2d-4cc3-b5b2-cdf591d727d2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.288676 May 19 16:44:11.335695 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 97/189] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:11 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:11.613565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-0aad2a0b-0690-4552-9b94-ced38f65d8e0 req-7e539fac-9fa8-4d72-afd9-295660089ab3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a6d6a59-35a3-46b0-a92a-a3ae729071b7", "tag": "5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:11.632288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0aad2a0b-0690-4552-9b94-ced38f65d8e0 req-7e539fac-9fa8-4d72-afd9-295660089ab3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:11.633481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0aad2a0b-0690-4552-9b94-ced38f65d8e0 req-7e539fac-9fa8-4d72-afd9-295660089ab3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:11.647049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-0aad2a0b-0690-4552-9b94-ced38f65d8e0 req-7e539fac-9fa8-4d72-afd9-295660089ab3 service nova] Creating event network-changed:5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc for instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 on hv-cinder-84243 May 19 16:44:11.652585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-0aad2a0b-0690-4552-9b94-ced38f65d8e0 req-7e539fac-9fa8-4d72-afd9-295660089ab3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043386 May 19 16:44:11.654096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 93/190] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:44:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:44:12.353579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:12.354212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:12.361906 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:12.362295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:12.363082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:12.363522 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:12.518063 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:12.526686 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-25947c11-81fc-4a5b-b64a-b3ee26511fac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.178516 May 19 16:44:12.527507 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 98/191] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:12 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:13.544946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:13.546566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:13.554095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:13.554644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:13.555421 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:13.555753 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:13.697101 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:13.704848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a2296432-1235-411b-87e1-4133f7742fed tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.164804 May 19 16:44:13.705445 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 94/192] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:13 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:14.723517 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:14.724127 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:14.732119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:14.732563 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:14.733497 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:14.735049 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:14.868892 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:14.876327 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ae3e09e5-324b-4866-a98e-348fc6cf054f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.158172 May 19 16:44:14.876884 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 99/193] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:14 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:15.894437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:15.895207 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:15.901802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:15.902254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:15.903042 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:15.903474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:16.058850 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:16.069992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-30e1080d-7693-4a71-97b9-77bc5365503a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.180010 May 19 16:44:16.070572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 95/194] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:15 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:17.092823 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:17.094230 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:17.101777 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:17.102228 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:17.103238 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:17.103811 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:17.257276 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:17.265613 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e726218a-caec-4a9a-b393-a52962087fc1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.180576 May 19 16:44:17.266206 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 100/195] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:17 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:18.284956 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:18.286232 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:18.297454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:18.297948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:18.298771 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:18.299217 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:18.471670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:18.480537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fb95f1a8-6160-4c97-922a-597134145b0c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.201749 May 19 16:44:18.481200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 96/196] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:18 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:19.122327 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:19.122917 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:19.131965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:19.132415 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:19.133222 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:19.133678 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:19.161316 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:44:19.263739 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3c08be3d-ee75-4d87-829f-5b9fe0d3e597 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 204 len: 0 microversion: 2.1 time: 0.146296 May 19 16:44:19.267897 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 101/197] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:44:19 2022] DELETE /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:44:19.275588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:19.276963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:19.292790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:19.294011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:19.295047 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:19.295797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:19.431217 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:19.439886 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6fd60f1b-8287-487c-95bd-279e8c85f64e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.169646 May 19 16:44:19.440473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 97/198] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:19 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:19.497709 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:19.498424 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:19.504915 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:19.505656 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:19.506426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:19.506889 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:19.706605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:19.714298 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-17ede6e9-f5dd-4e6b-805d-b6b112e4262a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.221082 May 19 16:44:19.715257 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 102/199] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:19 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:20.462016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:20.462625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:20.469172 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:20.469639 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:20.470397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:20.470851 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:20.622426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:20.633871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b8aec4a2-df51-4b74-a366-ae2ca864bad5 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.178224 May 19 16:44:20.637744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 98/200] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:20 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:20.731619 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:20.732358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:20.739170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:20.739676 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:20.740623 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:20.741336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:20.889261 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:20.899020 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2a86c4a2-9496-49d2-b4ff-02ade17564be tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.171062 May 19 16:44:20.899744 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 103/201] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:20 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:21.650899 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:21.651508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:21.657711 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:21.658163 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:21.659097 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:21.659538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:21.790264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:21.798943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b7b7c2da-9e5d-48ee-bb3a-d33d80c4549b tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.151906 May 19 16:44:21.799504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 99/202] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:21 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:21.916041 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:21.916640 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:21.923402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:21.923850 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:21.924618 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:21.925051 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:22.054652 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:22.062858 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f2c2c13b-551c-4ec3-b05a-89c7e66a1694 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.150838 May 19 16:44:22.063429 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 104/203] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:21 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:22.815655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:22.816421 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:22.822818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:22.823245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:22.823999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:22.824431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:22.956643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:22.965904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5570d267-bcaa-436c-be73-785d7ddba8b4 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.153378 May 19 16:44:22.965904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 100/204] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:22 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:23.079831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:23.080450 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:23.087046 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:23.087506 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:23.088278 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:23.088717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:23.228392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:23.238127 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-97ef7406-5744-43dc-9ed6-c7ee9042d3ae tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.162167 May 19 16:44:23.238696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 105/205] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:23 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:23.982797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:23.985604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:23.991734 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:23.992178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:23.992956 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:23.993434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:24.119158 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:24.127207 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1b985db8-e581-4e34-b41c-a343ac4a880d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.148182 May 19 16:44:24.127583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 101/206] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:23 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:24.254797 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:24.255572 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:24.261952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:24.262398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:24.263145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:24.263575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:24.397719 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:24.405058 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-514367f9-e08a-4cc8-b5d7-be60648e3af2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.154142 May 19 16:44:24.405675 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 106/207] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:24 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:25.144671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:25.145301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:25.151307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:25.151745 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:25.152496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:25.152926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:25.161005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:25.292234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:25.300706 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a3504977-daad-46c2-9db6-c8b42cf133f6 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.159882 May 19 16:44:25.301309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 102/208] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:25 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:25.422643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:25.423188 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:25.429735 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:25.430181 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:25.430930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:25.431353 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:25.564516 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:25.572181 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d5204216-8062-46be-ae76-a4083788f517 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.154178 May 19 16:44:25.572782 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 107/209] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:25 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:26.317496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:26.318130 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:26.324380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:26.324831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:26.325639 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:26.326056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:26.589768 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:26.590472 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:26.597579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:26.598027 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:26.598795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:26.599228 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:26.608246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:26.617343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ce078197-b5f6-48b5-b05e-01690e3b111a tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.303570 May 19 16:44:26.618020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 103/210] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:26 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:26.744321 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:26.751842 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8aac2f1a-1331-4a20-ac25-5358366a3f6d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.165916 May 19 16:44:26.752399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 108/211] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:26 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:27.364866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-530296802", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "networks": [{"uuid": "3d757d63-7d26-43b7-b546-eb7adc1b7dc9"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:27.422982 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] validate_networks() for [('3d757d63-7d26-43b7-b546-eb7adc1b7dc9', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:44:27.635084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:27.636327 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:27.643377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:27.643833 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:27.644605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:27.645335 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:27.805255 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:44:27.805772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:44:27.806465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:44:27.806943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:44:27.807434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:44:27.818366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:27.818896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:27.819770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:27.820277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:27.830940 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:27.834840 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:27.837959 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Getting quotas for project 3cee796edf9b42538358459363ea24ca. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:44:27.841859 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0165adc2-1980-4ef8-8c12-4d450b23c9c3 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.211325 May 19 16:44:27.842186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Getting quotas for user e9c52d463394487d94e55aed8c44068a and project 3cee796edf9b42538358459363ea24ca. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:44:27.842644 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 109/212] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:27 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:27.847721 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:27.848409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:27.854363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:44:27.855113 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:27.855805 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:27.856661 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:27.857024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:44:27.857489 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:27.931351 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-af9bb916-8d0b-4ef2-96f9-c29e662031e8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.570153 May 19 16:44:27.932300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 104/213] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:44:27 2022] POST /compute/v2.1/servers => generated 380 bytes in 572 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:44:27.942621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6f1be623-2662-4cc6-9792-c180646f123e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:27.943447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6f1be623-2662-4cc6-9792-c180646f123e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:28.007000 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6f1be623-2662-4cc6-9792-c180646f123e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:28.014891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6f1be623-2662-4cc6-9792-c180646f123e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1218 microversion: 2.1 time: 0.076141 May 19 16:44:28.015709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 105/214] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:27 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1218 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:28.078297 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:28.086786 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-755cee6e-c6d7-4fb1-b008-121f3a548110 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.242409 May 19 16:44:28.096810 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 110/215] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:27 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:28.859304 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:28.860373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:28.866541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:28.867001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:28.867766 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:28.868204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:29.012906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:29.020933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-48248bf4-1558-44a7-be7b-8ad364cf8b3f tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.165574 May 19 16:44:29.021537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 106/216] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:28 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:29.033465 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:29.034205 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:29.040856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:29.041421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:29.042263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:29.042816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:29.102805 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:29.103476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:29.109145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:29.110536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:29.110843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:29.111796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:29.112457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:29.118866 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fc517361-8b4e-43c3-b802-463d46464dca tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1222 microversion: 2.1 time: 0.090770 May 19 16:44:29.119448 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 111/217] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:29 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1222 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:29.252781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:29.261448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6955c7bd-62c4-4bdf-b3e7-e5e8ea3f7300 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.162441 May 19 16:44:29.262021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 107/218] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:29 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:30.037870 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:30.039087 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:30.046629 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:30.047942 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:30.049223 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:30.049816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:30.136178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:30.136786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:30.143895 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:30.144417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:30.145211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:30.145648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:30.198235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:30.206497 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-46d9ff18-d07c-44a2-9ee1-c59606e50f0c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.172594 May 19 16:44:30.212970 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 112/219] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:30 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:30.218923 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:30.226650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-115500a3-1f34-4830-973f-8f7d8c9f4f1d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1222 microversion: 2.1 time: 0.094626 May 19 16:44:30.227216 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 108/220] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:30 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:30.279011 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:30.279748 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:30.281827 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:30.287738 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:30.288191 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:30.288962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:30.289427 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:30.432763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:30.440783 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-684fcc22-9751-4d8d-9c17-e4f94a51117f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.165823 May 19 16:44:30.441395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 113/221] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:30 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:31.223496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:31.224048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:31.225961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:31.231228 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:31.231679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:31.232438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:31.232873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:31.243640 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:31.244278 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:31.251336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:31.251780 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:31.252534 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:31.252965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:31.315926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:31.323787 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f4e8ab78-f270-4f84-a98e-464d7dd8e65d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1222 microversion: 2.1 time: 0.083916 May 19 16:44:31.324363 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 114/222] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:31 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1222 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:31.365033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:31.373419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7292670a-c8d8-4693-a099-02e9b6009bcf tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.153801 May 19 16:44:31.373984 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 109/223] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:31 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:31.457607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:31.458212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:31.464160 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:31.464603 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:31.465378 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:31.465808 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:31.603401 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:31.614358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-24e00586-7338-43a7-92f5-35fffc3499fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.161279 May 19 16:44:31.615236 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 115/224] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:31 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:32.341197 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:32.341736 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:32.348444 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:32.348886 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:32.349671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:32.350102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:32.393034 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:32.396933 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:32.404212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:32.405051 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:32.405448 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:32.406050 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:32.418603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:32.426151 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f8ecfa3f-5ba8-46e2-9fb1-ad3c39cfff51 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1214 microversion: 2.1 time: 0.088897 May 19 16:44:32.426808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 110/225] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:32 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:32.535174 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:32.543547 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-19dc8b26-135f-4479-9ef8-c528d5bc0a63 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.156672 May 19 16:44:32.544113 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 116/226] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:32 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:32.631747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:32.632353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:32.638477 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:32.638929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:32.639690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:32.640125 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:32.772867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:32.780387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9c164a63-cab9-4161-8092-92d6a8233573 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.152795 May 19 16:44:32.781506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 111/227] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:32 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:33.444633 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:33.445270 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:33.452486 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:33.453604 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:33.454382 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:33.454817 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:33.517913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:33.525353 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-94974f7e-03bf-4268-904d-5ffe090e24a6 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1270 microversion: 2.1 time: 0.085185 May 19 16:44:33.525912 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 117/228] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:33 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1270 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:33.560967 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:33.561599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:33.568230 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:33.568685 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:33.569486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:33.569922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:33.699793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:33.708838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fcfbda85-163c-4720-9559-a7ec3b57395d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.151630 May 19 16:44:33.709467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 112/229] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:33 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:33.797715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:33.798344 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:33.804438 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:33.804880 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:33.805673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:33.806105 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:33.946003 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:33.953977 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3fb1ea8f-7c68-4b63-b45f-7b79b2e91a8d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.159954 May 19 16:44:33.954481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 118/230] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:33 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:34.541832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:34.542442 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:34.548995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:34.549474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:34.550243 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:34.550681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:34.620776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:34.628905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bf4337ed-444f-4e38-9bbd-dd964dea2bde tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1278 microversion: 2.1 time: 0.090826 May 19 16:44:34.629500 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 113/231] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:34 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1278 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:34.725376 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:34.725922 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:34.732446 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:34.732920 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:34.733682 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:34.734643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:34.877357 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:34.885818 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a0c3199f-639a-4336-98a2-8723b984f498 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.164345 May 19 16:44:34.886481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 119/232] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:34 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:34.971393 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:34.972071 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:34.980023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:34.980023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:34.980023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:34.980023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:35.115995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:35.123454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c3aef5c6-d92c-4138-a7a5-2ba5def12c39 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.156670 May 19 16:44:35.124018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 114/233] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:34 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:35.648837 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:35.649639 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:35.656239 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:35.656686 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:35.657513 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:35.657944 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:35.729458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:35.737426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2f506339-8920-4ef3-a16e-7bbcf2fdecf9 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1278 microversion: 2.1 time: 0.092355 May 19 16:44:35.737998 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 120/234] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:35 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1278 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:35.903070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:35.903686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:35.910817 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:35.910817 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:35.911104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:35.911665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:36.053700 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:36.061811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-53340370-b55f-460c-a4b8-e8b3bc4db56d tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.162527 May 19 16:44:36.062962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 115/235] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:35 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:36.140242 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:36.140879 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:36.146873 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:36.147319 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:36.148095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:36.148530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:36.298152 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:36.306067 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-72804125-9da6-436d-8a5a-18faf6321a18 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.169629 May 19 16:44:36.307114 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 121/236] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:36 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:36.755307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:36.756390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:36.769879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:36.770616 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:36.772866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:36.773387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:36.909449 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:36.921107 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f30ee27a-8ca4-4732-b117-ca07860159cc tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1278 microversion: 2.1 time: 0.169037 May 19 16:44:36.922931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 116/237] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:36 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1278 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:37.081845 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:37.083424 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:37.091279 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:37.091808 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:37.092659 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:37.093538 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:37.324174 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:37.324818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:37.332322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:37.332778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:37.333732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:37.334552 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:37.444180 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:37.456342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-798fa8d3-366b-4481-8593-9612f977ef54 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1552 microversion: 2.1 time: 0.379358 May 19 16:44:37.457560 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 122/238] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:37 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1552 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:37.523838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:37.534003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ff9c3915-0d2e-4ddf-92a9-e79cc09e16ad tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.213909 May 19 16:44:37.534964 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 117/239] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:37 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:37.930294 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-c404c38c-aacf-4941-8b4d-79230759ccf5 req-2c4493d1-a3b4-4502-951d-2d0119fa902b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8308d660-3fe8-4074-9faf-3ba85cf16ac6", "name": "network-vif-deleted", "tag": "a75788bb-8af6-425e-8f2f-8b760e4f3dee"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:37.940141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c404c38c-aacf-4941-8b4d-79230759ccf5 req-2c4493d1-a3b4-4502-951d-2d0119fa902b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:37.940338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:37.940782 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c404c38c-aacf-4941-8b4d-79230759ccf5 req-2c4493d1-a3b4-4502-951d-2d0119fa902b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:37.942941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:37.948671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:37.954559 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-c404c38c-aacf-4941-8b4d-79230759ccf5 req-2c4493d1-a3b4-4502-951d-2d0119fa902b service nova] Creating event network-vif-deleted:a75788bb-8af6-425e-8f2f-8b760e4f3dee for instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 on hv-cinder-84243 May 19 16:44:37.958114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:37.960279 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:37.960708 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-c404c38c-aacf-4941-8b4d-79230759ccf5 req-2c4493d1-a3b4-4502-951d-2d0119fa902b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036681 May 19 16:44:37.961304 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:37.961447 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 123/240] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:44:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:44:37.963245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:38.012302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:38.135759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:38.143506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7647714e-fdf0-43b5-96f7-b74b11e6cc17 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.207886 May 19 16:44:38.144311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 118/241] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:37 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:38.481445 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:38.482302 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:38.491631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:38.492229 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:38.493166 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:38.493730 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:38.553992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:38.555370 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:38.564215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:38.564907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:38.565987 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:38.566780 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:38.615953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:38.624187 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-510795b6-cd27-46ef-97ab-348a6e1e388c tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1345 microversion: 2.1 time: 0.152384 May 19 16:44:38.626592 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 124/242] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:38 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1345 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:38.819777 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:38.831940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dba2a7b8-e693-4552-a00c-22fba3f6b25b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1521 microversion: 2.1 time: 0.283851 May 19 16:44:38.833284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 119/243] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:38 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1521 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:39.161080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:39.162084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:39.171311 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.172427 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:39.174499 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.175769 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:39.435049 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:39.443410 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-359365a1-cb07-4a75-bace-06fce1d97c37 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.286815 May 19 16:44:39.444079 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 125/244] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:39 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:39.646249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:39.648288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:39.657870 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.658625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:39.659788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.660419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:39.687266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:39.707024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.707724 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:39.708359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lazy-loading 'fault' on Instance uuid 8308d660-3fe8-4074-9faf-3ba85cf16ac6 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:44:39.760132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '26bcad09cb7749d780d151d3d2862795', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16022d299eda48e6bf4675055870a140', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:39.768089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b09f517e-ec4e-42b9-93ea-593e9ae7e079 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 200 len: 1304 microversion: 2.1 time: 0.127895 May 19 16:44:39.768675 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 120/245] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:39 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:39.849631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:39.851073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:39.858159 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.858696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:39.859564 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.860197 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:39.985895 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-3fb35741-4787-4378-aa67-1f53fcee144f req-1ef398b8-435b-4b39-98f3-b3a9a28d82ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "362a1562-ca96-486a-94a2-02c7eb3a8c4d", "tag": "ab12d705-4be6-4560-914e-9c3166275d2d"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:39.993872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3fb35741-4787-4378-aa67-1f53fcee144f req-1ef398b8-435b-4b39-98f3-b3a9a28d82ad service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:39.994316 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3fb35741-4787-4378-aa67-1f53fcee144f req-1ef398b8-435b-4b39-98f3-b3a9a28d82ad service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.005964 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-3fb35741-4787-4378-aa67-1f53fcee144f req-1ef398b8-435b-4b39-98f3-b3a9a28d82ad service nova] Creating event network-changed:ab12d705-4be6-4560-914e-9c3166275d2d for instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d on hv-cinder-84243 May 19 16:44:40.010925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-3fb35741-4787-4378-aa67-1f53fcee144f req-1ef398b8-435b-4b39-98f3-b3a9a28d82ad service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028747 May 19 16:44:40.011559 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 121/246] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:44:40.138194 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:40.146253 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-60989f0e-aa04-44a8-8ce2-6266d14d1ea8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1501 microversion: 2.1 time: 0.300867 May 19 16:44:40.146837 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 126/247] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:39 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1501 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:40.163571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:40.164700 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:40.171523 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.171965 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.172735 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.173186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.315961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:40.324534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-40e2299e-b241-458f-af99-67d8176d6d69 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1515 microversion: 2.1 time: 0.165697 May 19 16:44:40.325393 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 122/248] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:40 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1515 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:40.463387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:40.464475 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:40.474648 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.475875 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.477096 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.478048 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.486547 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:40.658812 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:40.667279 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b8c15405-3034-4128-9f6f-aa6530d93b70 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.210590 May 19 16:44:40.668030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 127/249] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:40 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:40.785355 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:40.785964 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:40.794126 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.794737 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.795691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.796116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.815498 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] HTTP exception thrown: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Request method failure captured: May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 HTTP/1.1 May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOTnQTzhAPcsmUO6Mbl8Bn01YtwrZzUVCpgmACElyXRwNm86E9C1Kd9B5nf1iK7veidmKyM78ZolWtMdzqK-8JGrGli7TmYPjXEslw6beHUaXZDsTlwMqjIVJ5zC1Tf2JReRVnLCXNZDS5QjK9pPYyu7EBCzzzdwCSS4ieoecO3iAY May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:44:40.820132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/16022d299eda48e6bf4675055870a140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_16022d299eda48e6bf4675055870a140", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-DeleteServersTestJSON-153646916 May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 26bcad09cb7749d780d151d3d2862795 May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.821411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '8308d660-3fe8-4074-9faf-3ba85cf16ac6'} May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:44:40.822227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.826969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:40.828543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Returning 404 to user: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:44:40.828543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-60c55311-6c00-4f1d-ae57-fd2fb6616ce0 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 404 len: 111 microversion: 2.1 time: 0.040150 May 19 16:44:40.828543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 123/250] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:40 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:44:40.937219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:40.937861 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:40.945987 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.946499 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.947335 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:40.947770 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:40.960423 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] HTTP exception thrown: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Request method failure captured: May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6/os-volume_attachments HTTP/1.1 May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOTnQTzhAPcsmUO6Mbl8Bn01YtwrZzUVCpgmACElyXRwNm86E9C1Kd9B5nf1iK7veidmKyM78ZolWtMdzqK-8JGrGli7TmYPjXEslw6beHUaXZDsTlwMqjIVJ5zC1Tf2JReRVnLCXNZDS5QjK9pPYyu7EBCzzzdwCSS4ieoecO3iAY May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:44:40.964869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/16022d299eda48e6bf4675055870a140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_16022d299eda48e6bf4675055870a140", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-DeleteServersTestJSON-153646916 May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 26bcad09cb7749d780d151d3d2862795 May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.967112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'server_id': '8308d660-3fe8-4074-9faf-3ba85cf16ac6'} May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:44:40.969789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:40.971742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:40.974794 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Returning 404 to user: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:44:40.974794 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cbcf177f-8c3c-49b6-b046-e05fd9fbba86 tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.034546 May 19 16:44:40.974794 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 128/251] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:44:40 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6/os-volume_attachments => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:44:41.685777 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:41.686619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:41.694507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:41.695263 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:41.696640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:41.697277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:41.785925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:41.787141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:41.793784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:41.794426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:41.795216 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:41.795764 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:41.824681 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lazy-loading 'flavor' on Instance uuid e2d2c19b-7d96-4f1e-8f4a-7644b068da7f {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:44:41.857326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:41.865862 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-65cee668-3429-464e-bc07-a6d0b02831a3 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.184047 May 19 16:44:41.866732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 124/252] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:41 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:41.912904 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1f3a4d2c-426d-4a05-9ab7-d128f9e02ddb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f/action" status: 200 len: 32 microversion: 2.1 time: 0.131165 May 19 16:44:41.913627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 129/253] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:44:41 2022] POST /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f/action => generated 32 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 16:44:41.923136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:41.924000 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:41.930250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:41.930958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:41.931841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:41.932161 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:42.074600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:42.082478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-525cb8a9-789d-454d-838d-6cd674ba98ac tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.163253 May 19 16:44:42.083123 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 125/254] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:41 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:42.178513 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:42.179277 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:42.186424 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:42.187704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:42.188416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:42.188856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:42.203466 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] HTTP exception thrown: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Request method failure captured: May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 HTTP/1.1 May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOTnQTzhAPcsmUO6Mbl8Bn01YtwrZzUVCpgmACElyXRwNm86E9C1Kd9B5nf1iK7veidmKyM78ZolWtMdzqK-8JGrGli7TmYPjXEslw6beHUaXZDsTlwMqjIVJ5zC1Tf2JReRVnLCXNZDS5QjK9pPYyu7EBCzzzdwCSS4ieoecO3iAY May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:44:42.205790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/16022d299eda48e6bf4675055870a140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_16022d299eda48e6bf4675055870a140", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-DeleteServersTestJSON-153646916 May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 26bcad09cb7749d780d151d3d2862795 May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.207370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': '8308d660-3fe8-4074-9faf-3ba85cf16ac6'} May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:44:42.208307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.209627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:44:42.211852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Returning 404 to user: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:44:42.212701 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-af66ebeb-100b-4f42-961e-e0b4ca13cbbb tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 404 len: 111 microversion: 2.1 time: 0.039631 May 19 16:44:42.213605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 130/255] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:44:42 2022] DELETE /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:44:42.221467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:42.222081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] [instance: 8308d660-3fe8-4074-9faf-3ba85cf16ac6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:42.228014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:42.228461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:42.229291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:42.229719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:42.244145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] HTTP exception thrown: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Request method failure captured: May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 HTTP/1.1 May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOTnQTzhAPcsmUO6Mbl8Bn01YtwrZzUVCpgmACElyXRwNm86E9C1Kd9B5nf1iK7veidmKyM78ZolWtMdzqK-8JGrGli7TmYPjXEslw6beHUaXZDsTlwMqjIVJ5zC1Tf2JReRVnLCXNZDS5QjK9pPYyu7EBCzzzdwCSS4ieoecO3iAY May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:44:42.245677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/16022d299eda48e6bf4675055870a140"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_16022d299eda48e6bf4675055870a140", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/16022d299eda48e6bf4675055870a140"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-DeleteServersTestJSON-153646916 May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 16022d299eda48e6bf4675055870a140 May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-DeleteServersTestJSON-153646916 May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 26bcad09cb7749d780d151d3d2862795 May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-DeleteServersTestJSON-153646916-project May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.247082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '8308d660-3fe8-4074-9faf-3ba85cf16ac6'} May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:44:42.251808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. May 19 16:44:42.253599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:44:42.254802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] Returning 404 to user: Instance 8308d660-3fe8-4074-9faf-3ba85cf16ac6 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:44:42.254802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d6be6002-6456-40a1-bce3-01a58025b79e tempest-DeleteServersTestJSON-153646916 tempest-DeleteServersTestJSON-153646916-project] 10.222.0.36 "GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6" status: 404 len: 111 microversion: 2.1 time: 0.029536 May 19 16:44:42.254802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 126/256] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:42 2022] GET /compute/v2.1/servers/8308d660-3fe8-4074-9faf-3ba85cf16ac6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:44:42.883583 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:42.884342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:42.893219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:42.893775 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:42.894641 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:42.895149 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:43.035539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:43.043103 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e85577af-c256-433d-a116-095df0a1d7ec tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.163758 May 19 16:44:43.043757 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 131/257] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:42 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:43.100121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:43.100725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:43.107179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:43.107631 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:43.108394 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:43.109494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:43.278105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:43.287927 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d983a4d3-43d6-41fa-8d3b-0d9cae27d93d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.191516 May 19 16:44:43.288513 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 127/258] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:43 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:44.059786 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:44.060444 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:44.068343 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:44.068913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:44.070014 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:44.070568 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:44.225354 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:44.233819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5dbe1a49-adaa-4228-a27f-1060c1f057d2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.177854 May 19 16:44:44.235054 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 132/259] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:44 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:44.306861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:44.308016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:44.317224 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:44.318043 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:44.319309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:44.319749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:44.597086 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:44.605897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-54781e2a-0a28-4e57-babf-65c1ffe8dc29 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.303722 May 19 16:44:44.607240 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 128/260] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:44 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:45.252039 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:45.253434 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:45.260283 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:45.261221 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:45.262212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:45.262861 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:45.431170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:45.439311 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4327ef56-4529-4839-8655-97c5901cf388 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.191745 May 19 16:44:45.439924 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 133/261] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:45 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:45.627144 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:45.628559 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:45.640605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:45.641250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:45.653312 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:45.669976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.028s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:46.249865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:46.262012 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1d7c8bcf-551e-4a43-b2ba-2dd6351ccab8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.641860 May 19 16:44:46.263352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 129/262] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:45 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:46.476185 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:46.477005 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:46.544969 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:46.545877 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:46.548052 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:46.551941 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:46.752274 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:46.761342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9c404aa7-ebb4-4fb1-baf9-fe2be17c3dfe tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.308207 May 19 16:44:46.761915 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 134/263] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:46 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:47.279709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:47.281071 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:47.288060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:47.288821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:47.289868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:47.290501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:47.511778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:47.520929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-492a95b0-2a71-4682-a0f4-0106a39d0e50 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.244951 May 19 16:44:47.521866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 130/264] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:47 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:47.779019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:47.780307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:47.788047 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:47.788853 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:47.789857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:47.790488 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:48.010704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:48.024235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-65ea486e-4cdd-4af1-8863-8e11fc06e79e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.248209 May 19 16:44:48.030343 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 135/265] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:47 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:48.369546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-a4f49864-1274-4adc-8eac-502a4c36a9ec req-963d7fef-0e9a-4814-920f-f9528dd2769d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362a1562-ca96-486a-94a2-02c7eb3a8c4d", "name": "network-vif-plugged", "status": "completed", "tag": "ab12d705-4be6-4560-914e-9c3166275d2d"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:48.380646 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a4f49864-1274-4adc-8eac-502a4c36a9ec req-963d7fef-0e9a-4814-920f-f9528dd2769d service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:48.382461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a4f49864-1274-4adc-8eac-502a4c36a9ec req-963d7fef-0e9a-4814-920f-f9528dd2769d service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:48.410780 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-a4f49864-1274-4adc-8eac-502a4c36a9ec req-963d7fef-0e9a-4814-920f-f9528dd2769d service nova] Creating event network-vif-plugged:ab12d705-4be6-4560-914e-9c3166275d2d for instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d on hv-cinder-84243 May 19 16:44:48.416437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-a4f49864-1274-4adc-8eac-502a4c36a9ec req-963d7fef-0e9a-4814-920f-f9528dd2769d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050299 May 19 16:44:48.417634 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 131/266] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:44:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:44:48.539843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:48.540456 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:48.550035 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:48.552386 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:48.553251 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:48.553677 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:48.955415 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:48.965431 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-da9a8e98-c59d-48b1-a46c-eebdfcac252b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.430674 May 19 16:44:48.970961 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 136/267] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:48 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:49.042510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:49.043286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:49.056488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:49.056999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:49.058299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:49.058892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:49.369178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:49.382373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b4a6b680-e6f3-45d9-b4bf-023e479138b2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.345001 May 19 16:44:49.385560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 132/268] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:49 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:49.750526 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-870a4555-79e4-4d0e-b56d-7a4480402c37 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'create', calling method: .version_select at 0x7f489373b550>, body: {"keypair": {"name": "tempest-keypair-815400689", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJ+SaMinn+jQZBpozaEdGOiEautadJ0/I3QgqVfIyAc/7Xr5X5McBSg0Be12o2cMYStGzPF+mJvftXWZXwQ0WYlPvTzZe2hunhc8SBwcyGz5UmUNPxfjLVnanM6p/fmcEA=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:49.766454 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-870a4555-79e4-4d0e-b56d-7a4480402c37 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:44:49.770340 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-870a4555-79e4-4d0e-b56d-7a4480402c37 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for user 4077d35bf1044be79bfaa013e13c530e and project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:44:49.793929 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-870a4555-79e4-4d0e-b56d-7a4480402c37 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.359808 May 19 16:44:49.794536 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 137/269] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:44:49 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:44:49.983329 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:49.984749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:49.993424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:49.993876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:49.994857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:49.995298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:50.202616 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:50.212001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0ee52865-7dbc-4285-b1ff-7df3446a0c72 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.233119 May 19 16:44:50.222360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 133/270] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:49 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:50.414690 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:50.416854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:50.426961 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:50.427707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:50.428723 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:50.429295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:50.638228 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:50.652021 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6255c6d1-2b09-4492-97b7-c4c2a5c0436d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1318 microversion: 2.1 time: 0.253847 May 19 16:44:50.653246 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 138/271] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:50 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1318 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:51.235879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:51.238052 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:51.249031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:51.249960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:51.251652 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:51.252383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:51.511837 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:51.524800 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7fb8f774-40f0-4115-be39-8ec1a7e95064 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.298954 May 19 16:44:51.535505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 134/272] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:51 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:51.670117 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:51.670888 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:51.684013 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:51.705360 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:51.715435 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:51.716820 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:51.955339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-710525550", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d502c5b6-89c2-49f6-8ac0-adfabdff9156"}], "security_groups": [{"name": "tempest-securitygroup--1048154271"}], "key_name": "tempest-keypair-815400689", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:51.959556 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:51.970973 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-abfef584-77d8-4413-b342-40d444015548 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1507 microversion: 2.1 time: 0.304276 May 19 16:44:51.971704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 139/273] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:51 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1507 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:52.164537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] validate_networks() for [('d502c5b6-89c2-49f6-8ac0-adfabdff9156', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:44:52.543091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:52.543732 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:52.555597 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:52.560298 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:52.561542 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:52.562317 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:52.834114 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:52.842460 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8c59725b-cc8a-49ff-a0c8-f11f8379bf7d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.303254 May 19 16:44:52.847190 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 140/274] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:52 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:44:52.969463 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:44:52.969922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:44:52.970358 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:44:52.970770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:44:52.971208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:44:52.986280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:52.986924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:52.987972 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:52.988389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:53.012289 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:44:53.017145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for user 4077d35bf1044be79bfaa013e13c530e and project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:44:53.031588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:44:53.034705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:44:53.152803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aa5b1b27-2717-4763-992f-d717c902cf48 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.202535 May 19 16:44:53.157251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 135/275] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:44:51 2022] POST /compute/v2.1/servers => generated 402 bytes in 1208 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:44:53.167361 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-92c10d89-d62f-4a4d-9bde-f9626b95e25f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:53.168213 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-92c10d89-d62f-4a4d-9bde-f9626b95e25f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:53.275176 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-92c10d89-d62f-4a4d-9bde-f9626b95e25f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:53.283866 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-92c10d89-d62f-4a4d-9bde-f9626b95e25f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1236 microversion: 2.1 time: 0.120277 May 19 16:44:53.294388 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 141/276] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:53 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1236 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:53.867192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:53.868726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:53.879541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:53.880716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:53.881573 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:53.882360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:54.111867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:54.129413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e59776b6-d13b-4d04-9547-b7edc5ba03e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.269640 May 19 16:44:54.131676 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 136/277] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:53 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:54.302788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:54.303324 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:54.313216 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:54.313923 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:54.314865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:54.315454 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:54.394204 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:54.407747 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f85b0e24-c242-4f91-b483-bee12e3646f7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1288 microversion: 2.1 time: 0.108930 May 19 16:44:54.417919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 142/278] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:54 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1288 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:55.149653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:55.150434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:55.159748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:55.161142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:55.162244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:55.163003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:55.322333 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:55.331804 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9ce38d45-09c4-44db-9830-42cda4d04647 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.187440 May 19 16:44:55.332390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 137/279] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:55 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:55.427251 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:55.428214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:55.439295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:55.440056 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:55.441112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:55.441514 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:55.529565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:55.546772 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-eface9db-a406-42fb-876c-48497cdb9b12 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1294 microversion: 2.1 time: 0.124981 May 19 16:44:55.554437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 143/280] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:55 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1294 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:56.348552 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:56.349430 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:56.356191 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:56.357045 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:56.358089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:56.358592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:56.514725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:56.535093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3118b97a-4ca1-4505-8b33-c9e032100c9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.190990 May 19 16:44:56.535785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 138/281] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:56 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:56.564475 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:56.566420 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:56.576264 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:56.576713 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:56.577553 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:56.578821 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:56.826361 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:56.849477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3774dc70-c305-400e-8c6c-25d5e856e023 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.289178 May 19 16:44:56.851136 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 144/282] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:56 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:56.933003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-eecefa1b-0eee-49a8-b1dd-29f6a5c4b5cd req-78ea7b9e-e916-4cbd-b87b-ec216b476615 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec996e03-c5eb-44e0-ad6c-cbe782fd443d", "tag": "aaa116bf-f964-4274-a879-27bf6f601715"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:44:56.946411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-eecefa1b-0eee-49a8-b1dd-29f6a5c4b5cd req-78ea7b9e-e916-4cbd-b87b-ec216b476615 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:56.946981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-eecefa1b-0eee-49a8-b1dd-29f6a5c4b5cd req-78ea7b9e-e916-4cbd-b87b-ec216b476615 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:56.972280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-eecefa1b-0eee-49a8-b1dd-29f6a5c4b5cd req-78ea7b9e-e916-4cbd-b87b-ec216b476615 service nova] Creating event network-changed:aaa116bf-f964-4274-a879-27bf6f601715 for instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d on hv-cinder-84243 May 19 16:44:56.981554 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-eecefa1b-0eee-49a8-b1dd-29f6a5c4b5cd req-78ea7b9e-e916-4cbd-b87b-ec216b476615 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052649 May 19 16:44:56.982161 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 139/283] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:44:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:44:57.555600 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:57.556386 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:57.562973 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:57.563421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:57.564454 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:57.564972 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:57.570889 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:57.723122 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:57.733594 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-58458cf5-1b10-4f88-b7a7-be44e890b255 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.182101 May 19 16:44:57.734496 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 145/284] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:57 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:57.870362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:57.870362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:57.875506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:57.875959 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:57.876735 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:57.877213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:58.043056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:58.045447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:44:58.052274 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-12af8544-384d-41c9-b5d3-68cb5b940b35 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.188396 May 19 16:44:58.052863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 140/285] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:57 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:58.751212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:58.751808 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:58.758523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:58.758965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:58.759715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:58.760170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:58.892262 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:58.899929 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-845a3077-592c-4119-a416-ef6f12857066 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.153295 May 19 16:44:58.900499 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 146/286] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:58 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:59.070262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:59.071128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:59.079950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:59.080393 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:59.081393 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:59.082380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:59.216630 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:44:59.226733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-68f823d5-f9d5-4b0c-a4b7-3775b95d2e9d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.161093 May 19 16:44:59.227461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 141/287] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:59 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:44:59.917470 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:44:59.918084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:44:59.925425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:59.925873 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:44:59.926638 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:44:59.927066 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:00.055743 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:00.063797 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-76ecaa47-2640-4434-9207-ccc93aea6fc3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.150302 May 19 16:45:00.064351 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 147/288] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:44:59 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:00.243188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:00.243717 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:00.250440 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:00.250890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:00.251648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:00.252087 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:00.381297 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:00.388606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bc9a11a4-9d4c-4b49-83c0-251d2f0164ce tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.149422 May 19 16:45:00.389186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 142/289] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:00 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:01.079816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:01.080428 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:01.082747 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:01.088611 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:01.089057 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:01.089841 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:01.090277 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:01.217783 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:01.225855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d7fc0fe0-5de0-4d6a-8835-03664bb0f9ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.149843 May 19 16:45:01.226423 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 148/290] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:01 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:01.405694 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:01.406872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:01.408746 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:01.414365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:01.414808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:01.415574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:01.416005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:01.550120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:01.558060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0a66926a-e704-4144-a6fe-2e60336d7c6f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.156161 May 19 16:45:01.558611 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 143/291] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:01 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:02.243446 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:02.243974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:02.251055 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:02.251502 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:02.252260 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:02.252696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:02.383486 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:02.390873 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-85ce7029-ab4e-40c7-9348-f676bac7fcff tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.151385 May 19 16:45:02.391442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 149/292] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:02 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:02.574812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:02.575419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:02.581481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:02.581927 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:02.582681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:02.583109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:02.722662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:02.731283 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a7a13cfa-2e0a-4831-8a66-5c639f469213 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.160074 May 19 16:45:02.732153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 144/293] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:02 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:03.408114 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:03.408738 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:03.411506 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=6 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:03.416890 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:03.417365 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:03.418139 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:03.418568 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:03.581168 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:03.588821 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-46a2d314-f00f-4cb0-b8d3-1129208b6485 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.184617 May 19 16:45:03.589426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 150/294] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:03 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:03.752138 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:03.752752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:03.754975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:03.755633 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:03.761451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:03.761890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:03.762676 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:03.763142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:03.898252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:03.905690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a8b24b1e-36c7-40d4-b1d8-54e954379c4d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.158149 May 19 16:45:03.906251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 145/295] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:03 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:04.606264 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:04.606861 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:04.613653 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:04.614105 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:04.614864 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:04.615292 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:04.757028 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:04.764565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d92bcc03-043f-4d35-95e3-4e29fd41abf2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.162150 May 19 16:45:04.765717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 151/296] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:04 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:04.922664 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:04.923621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:04.934808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:04.935384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:04.936273 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:04.936714 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:05.074423 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:05.082832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-50905c23-91c3-462f-98a7-3dc9acf404e6 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.164139 May 19 16:45:05.083408 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 146/297] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:04 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:05.782115 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:05.782807 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:05.792519 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:05.792977 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:05.793808 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:05.794420 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:05.938555 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:05.946306 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c99f64ba-c342-4e33-8c07-43e6a59da408 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.168168 May 19 16:45:05.946875 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 152/298] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:05 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:06.107990 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:06.109755 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:06.116951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:06.117439 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:06.118219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:06.118845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:06.255068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:06.262550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c3bdf211-3668-49c2-b35c-a7c4af200eac tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.164392 May 19 16:45:06.263105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 147/299] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:06 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:06.964284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:06.964813 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:06.971830 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:06.972538 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:06.973437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:06.973974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:07.124583 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:07.132437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b64ded57-984a-4871-b058-d5acb36e2fdf tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.173012 May 19 16:45:07.133034 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 153/300] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:06 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:07.280141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:07.280909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:07.287203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:07.287658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:07.288430 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:07.288865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:07.423671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:07.431243 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5a09223f-8fe0-4919-817c-beb07ff61480 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.155242 May 19 16:45:07.431810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 148/301] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:07 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:08.151530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:08.152141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:08.159234 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:08.159686 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:08.160569 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:08.161076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:08.312251 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:08.322318 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9e74f2be-880b-4119-a86a-f8bd2e540d64 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.174497 May 19 16:45:08.325588 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 154/302] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:08 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:08.448624 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:08.450464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:08.460640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:08.461107 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:08.461934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:08.462374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:08.668234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:08.677118 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a8482d1d-8351-40df-ae9e-45638e28d19c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.232929 May 19 16:45:08.678906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 149/303] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:08 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:09.342434 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:09.343661 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:09.350381 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.350909 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.351778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.352287 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.518361 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:09.525819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-79da353d-0922-493e-81f4-fa9210066d9d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1501 microversion: 2.1 time: 0.187288 May 19 16:45:09.526393 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 155/304] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:09 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1501 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:09.544701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "542e0dbf-3984-4087-9d1e-74ee1e855e1d"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:09.545897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:09.552759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.553327 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.554195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.554702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.579442 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] HTTP exception thrown: Cannot 'attach_volume' instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f while it is in vm_state rescued May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Request method failure captured: May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f/os-volume_attachments HTTP/1.1 May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 74 May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOdf_UrMrp5CunZyL8epnfGmidIgSd38Jxi6Nt0UzwimlAQmRoF2t99JizNDeT69ZbhLMxKD9tr9meqBwL9LUAsjM8ValOvUnMX_KaCJO4elB1SwDEplk74cwCe_9oGe_PZCqhHwrGNQtp9CZsSp3hK-NYkgIHwPcoknV4M4zxyPB0 May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:45:09.581553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3fbe05607bf945bbb756e7ed3764cccc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 6e88db1bf9294decaf171756772a5066 May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {"volumeAttachment": {"volumeId": "542e0dbf-3984-4087-9d1e-74ee1e855e1d"}} May 19 16:45:09.583110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Cannot 'attach_volume' instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f while it is in vm_state rescued May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'server_id': 'e2d2c19b-7d96-4f1e-8f4a-7644b068da7f', 'body': {'volumeAttachment': {'volumeId': '542e0dbf-3984-4087-9d1e-74ee1e855e1d'}}} May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f in vm_state rescued. Cannot attach_volume while the instance is in this state. May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:45:09.583848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f while it is in vm_state rescued May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:45:09.585017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:45:09.586347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:45:09.586347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:45:09.586347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f while it is in vm_state rescued May 19 16:45:09.586347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:45:09.586347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Returning 409 to user: Cannot 'attach_volume' instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f while it is in vm_state rescued {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:45:09.586347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-90347bbc-08a5-49ed-a56e-4701b3915fd0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042807 May 19 16:45:09.586773 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 150/305] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:45:09 2022] POST /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 16:45:09.595438 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-92d1a8b5-8d47-404e-bc2f-2c4f46fee1f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:09.596372 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-92d1a8b5-8d47-404e-bc2f-2c4f46fee1f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:09.606295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-92d1a8b5-8d47-404e-bc2f-2c4f46fee1f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.606843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-92d1a8b5-8d47-404e-bc2f-2c4f46fee1f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.607690 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-92d1a8b5-8d47-404e-bc2f-2c4f46fee1f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.608182 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-92d1a8b5-8d47-404e-bc2f-2c4f46fee1f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.681605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-92d1a8b5-8d47-404e-bc2f-2c4f46fee1f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f/action" status: 202 len: 0 microversion: 2.1 time: 0.089919 May 19 16:45:09.685821 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 156/306] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:45:09 2022] POST /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f/action => generated 0 bytes in 95 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:45:09.691379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:09.692007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:09.696217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:09.697013 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:09.698830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.699306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.700696 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.701218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.705961 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.706497 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.707342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:09.707876 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:09.903787 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:09.912004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fd974fb3-1a58-4365-8665-5a3736228174 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1509 microversion: 2.1 time: 0.225330 May 19 16:45:09.913040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 151/307] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:09 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1509 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:09.976084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:09.984965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-759a2372-9893-4806-bf99-80dee28818a3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.292897 May 19 16:45:09.986355 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 157/308] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:09 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:10.930082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:10.930724 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:10.937751 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:10.938206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:10.939227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:10.939673 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:11.003575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:11.004167 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:11.012558 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:11.013376 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:11.014328 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:11.015449 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:11.090709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:11.098664 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dade8ff5-c392-4051-9382-d558c44453de tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1509 microversion: 2.1 time: 0.172412 May 19 16:45:11.099803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 152/309] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:10 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1509 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:11.181912 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:11.190127 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8a631c75-6a61-49c2-821f-78f1664cfbba tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.191743 May 19 16:45:11.190788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 158/310] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:10 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:12.116183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:12.116791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:12.122819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:12.123269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:12.124095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:12.124529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:12.206984 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:12.207598 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:12.214386 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:12.214843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:12.215606 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:12.216042 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:12.261864 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:12.271846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-02b856bb-520a-471b-9771-1fb764c74af8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1509 microversion: 2.1 time: 0.160038 May 19 16:45:12.272968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 153/311] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:12 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1509 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:12.358912 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:12.366550 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1f7a34f6-ce5e-4d03-8315-0f0e33f9fb5c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.163854 May 19 16:45:12.367014 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 159/312] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:12 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:12.397413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-e740ff0c-c33d-47a1-9fb4-ce8200abcc60 req-3d653a14-8af8-490c-be04-3f774bcd5976 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec996e03-c5eb-44e0-ad6c-cbe782fd443d", "name": "network-vif-plugged", "status": "completed", "tag": "aaa116bf-f964-4274-a879-27bf6f601715"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:12.405951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-e740ff0c-c33d-47a1-9fb4-ce8200abcc60 req-3d653a14-8af8-490c-be04-3f774bcd5976 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:12.406591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-e740ff0c-c33d-47a1-9fb4-ce8200abcc60 req-3d653a14-8af8-490c-be04-3f774bcd5976 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:12.418489 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-e740ff0c-c33d-47a1-9fb4-ce8200abcc60 req-3d653a14-8af8-490c-be04-3f774bcd5976 service nova] Creating event network-vif-plugged:aaa116bf-f964-4274-a879-27bf6f601715 for instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d on hv-cinder-84243 May 19 16:45:12.423524 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-e740ff0c-c33d-47a1-9fb4-ce8200abcc60 req-3d653a14-8af8-490c-be04-3f774bcd5976 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030103 May 19 16:45:12.424105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 154/313] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:12.985997 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-301748814", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:13.036015 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] validate_networks() for None {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:45:13.290118 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:13.290815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:13.298428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:13.298887 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:13.299661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:13.300096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:13.384401 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:45:13.384835 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:45:13.385360 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:45:13.385766 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:45:13.386392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:45:13.395875 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:13.396327 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:13.397123 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:13.397587 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:13.416228 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Getting quotas for project 6c7652596e3b41d285e874ca1a675677. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:45:13.420831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Getting quotas for user 1d0fe4ce272e46509e8b744e17664ccd and project 6c7652596e3b41d285e874ca1a675677. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:45:13.433886 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:45:13.436141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:45:13.439546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:13.447926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9ff8f478-297b-4175-b3e9-7a922a65a2a0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1509 microversion: 2.1 time: 0.161973 May 19 16:45:13.448499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 155/314] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:13 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1509 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:13.463253 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:13.463875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:13.471300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:13.471710 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:13.472547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:13.472989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:13.498293 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ea8235b9-cc30-462d-91ad-d82f9f49073b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516544 May 19 16:45:13.513959 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 160/315] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:45:12 2022] POST /compute/v2.1/servers => generated 380 bytes in 533 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:45:13.529893 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f60e3b7d-57e2-4ddf-a685-f489d81ca4db tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:13.531753 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f60e3b7d-57e2-4ddf-a685-f489d81ca4db tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:13.601971 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f60e3b7d-57e2-4ddf-a685-f489d81ca4db tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:13.610825 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f60e3b7d-57e2-4ddf-a685-f489d81ca4db tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1214 microversion: 2.1 time: 0.088640 May 19 16:45:13.613137 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 161/316] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:13 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1214 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:13.635811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:13.643810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-be4d8010-1d23-4fe5-a82e-3ddf48aabf96 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.184353 May 19 16:45:13.644286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 156/317] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:13 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:14.465747 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:14.466419 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:14.473627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:14.474077 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:14.474871 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:14.475494 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:14.491050 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:14.627834 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:14.628441 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:14.635062 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:14.635510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:14.636275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:14.636708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:14.690002 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:14.699125 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9fccef37-c4d0-4487-9050-68ef46478c87 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1515 microversion: 2.1 time: 0.237154 May 19 16:45:14.699935 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 162/318] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:14 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1515 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:14.706169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:14.706848 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:14.713520 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:14.714176 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:14.714948 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:14.715383 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:14.719282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:14.727149 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ee17bb86-5bda-4954-b63f-b4b79bc6aab1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1266 microversion: 2.1 time: 0.103209 May 19 16:45:14.734865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 157/319] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:14 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1266 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:14.859153 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:14.868653 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-80b3602d-943a-4cb6-bcc0-bb501b1af807 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1362 microversion: 2.1 time: 0.167894 May 19 16:45:14.869457 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 163/320] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:14 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1362 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:15.746280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:15.746816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:15.753789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:15.754477 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:15.755443 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:15.756068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:15.775302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:15.828756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:15.836171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-73848324-0952-4f3a-8c53-7e48c177bcf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1266 microversion: 2.1 time: 0.094287 May 19 16:45:15.836727 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 158/321] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:15 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1266 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:15.886696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:15.887308 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:15.893772 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:15.894596 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:15.895016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:15.895454 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:16.025681 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:16.033840 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c4c8a879-7abb-4d73-b291-6440b71e9986 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1548 microversion: 2.1 time: 0.151212 May 19 16:45:16.034202 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 164/322] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:15 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:16.050582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5a648537-c40e-46fc-b049-e440e4149f3d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:16.051073 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5a648537-c40e-46fc-b049-e440e4149f3d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:16.057316 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a648537-c40e-46fc-b049-e440e4149f3d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:16.057767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a648537-c40e-46fc-b049-e440e4149f3d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:16.058523 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a648537-c40e-46fc-b049-e440e4149f3d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:16.058954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5a648537-c40e-46fc-b049-e440e4149f3d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:16.136941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5a648537-c40e-46fc-b049-e440e4149f3d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090663 May 19 16:45:16.137605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 159/323] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:45:16 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:45:16.855366 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:16.856395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:16.869223 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:16.869223 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:16.869829 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:16.870973 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:16.963210 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:16.971630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-21e57388-cc10-4050-b9a6-c8834c67a6b2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1272 microversion: 2.1 time: 0.121812 May 19 16:45:16.972218 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 165/324] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:16 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1272 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:17.104668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f17ca009-b592-435e-b280-cf587f328dc6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'create', calling method: .version_select at 0x7f48937c0310>, body: {"keypair": {"name": "tempest-keypair-1027727393", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMoQq7A+1YbOIL7qCIzcEY3/zo4JxS8lwAQDnR/l8pAtd/zbqSAmQnQ6XZblGQgiIWVEsj8bKz/qoyKQLFYCFzcXeZlm3xVjuAWOIl70C60RQW59k3U29loD+zIDUu7AoA=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:17.120775 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f17ca009-b592-435e-b280-cf587f328dc6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:45:17.125136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f17ca009-b592-435e-b280-cf587f328dc6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for user 6e88db1bf9294decaf171756772a5066 and project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:45:17.151553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f17ca009-b592-435e-b280-cf587f328dc6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.050735 May 19 16:45:17.152507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 160/325] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:45:17 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:17.641767 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-ba623ea7-4bd0-4621-a025-162c20722234 req-01168d2b-00b6-4ef5-8608-c5c4766872ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec996e03-c5eb-44e0-ad6c-cbe782fd443d", "tag": "aaa116bf-f964-4274-a879-27bf6f601715"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:17.650680 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-ba623ea7-4bd0-4621-a025-162c20722234 req-01168d2b-00b6-4ef5-8608-c5c4766872ff service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:17.651481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-ba623ea7-4bd0-4621-a025-162c20722234 req-01168d2b-00b6-4ef5-8608-c5c4766872ff service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:17.667586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-ba623ea7-4bd0-4621-a025-162c20722234 req-01168d2b-00b6-4ef5-8608-c5c4766872ff service nova] Creating event network-changed:aaa116bf-f964-4274-a879-27bf6f601715 for instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d on hv-cinder-84243 May 19 16:45:17.676696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-ba623ea7-4bd0-4621-a025-162c20722234 req-01168d2b-00b6-4ef5-8608-c5c4766872ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046439 May 19 16:45:17.681989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 166/326] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:17.990442 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:17.991682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:17.999513 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:18.000061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:18.000884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:18.001348 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:18.207362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:18.216479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-40edfbb9-5eb8-49dc-808c-66cfe5fc314b tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.230024 May 19 16:45:18.226885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 161/327] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:17 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:18.947715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-97ea777d-b7dd-4567-bfbf-bd22b86f34bc req-1d228997-5f4b-4e71-82d2-7316aec507f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3", "tag": "b4a3f8c2-04a8-493f-8d32-a89878ded8a5"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:18.971704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-97ea777d-b7dd-4567-bfbf-bd22b86f34bc req-1d228997-5f4b-4e71-82d2-7316aec507f8 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:18.972149 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-97ea777d-b7dd-4567-bfbf-bd22b86f34bc req-1d228997-5f4b-4e71-82d2-7316aec507f8 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:18.994752 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-97ea777d-b7dd-4567-bfbf-bd22b86f34bc req-1d228997-5f4b-4e71-82d2-7316aec507f8 service nova] Creating event network-changed:b4a3f8c2-04a8-493f-8d32-a89878ded8a5 for instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 on hv-cinder-84243 May 19 16:45:19.001948 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-97ea777d-b7dd-4567-bfbf-bd22b86f34bc req-1d228997-5f4b-4e71-82d2-7316aec507f8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066194 May 19 16:45:19.003594 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 167/328] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:19.235890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:19.237273 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:19.246217 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:19.247198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:19.249292 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:19.249929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:19.284834 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-913991812", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "ca9f7fe2-13d8-4e5e-a0b7-ed1642c0a592"}], "security_groups": [{"name": "tempest-securitygroup--1199715284"}], "key_name": "tempest-keypair-1027727393", "user_data": "}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:19.431109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:19.438708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b377fef-6ace-445e-aa77-fa6503b2ecf9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.208668 May 19 16:45:19.439367 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 162/329] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:19 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:19.500425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] validate_networks() for [('ca9f7fe2-13d8-4e5e-a0b7-ed1642c0a592', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:45:19.883523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:45:19.883950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:45:19.884426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:45:19.884860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:45:19.885336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:45:19.895120 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:19.895409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:19.896395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:19.896837 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:19.913438 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:45:19.917394 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Getting quotas for user 6e88db1bf9294decaf171756772a5066 and project 3fbe05607bf945bbb756e7ed3764cccc. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:45:19.928343 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:45:19.930738 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:45:19.977736 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-88660e18-33f3-499e-8b98-ba84169d75a8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.697963 May 19 16:45:19.978348 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 168/330] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:45:19 2022] POST /compute/v2.1/servers => generated 409 bytes in 700 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:45:19.988252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b9bf3b04-97c1-424a-b696-d3b5fe9cb22e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:19.988852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b9bf3b04-97c1-424a-b696-d3b5fe9cb22e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:20.047759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b9bf3b04-97c1-424a-b696-d3b5fe9cb22e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:20.056320 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b9bf3b04-97c1-424a-b696-d3b5fe9cb22e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1245 microversion: 2.1 time: 0.071759 May 19 16:45:20.056850 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 163/331] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:19 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:20.455433 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:20.456041 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:20.462342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:20.462787 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:20.463529 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:20.463951 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:20.593609 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:20.601327 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5000ada5-011c-4b7c-80ff-a24de64f862e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.149689 May 19 16:45:20.601901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 169/332] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:20 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:21.073382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:21.073985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:21.080450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:21.080893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:21.081674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:21.082103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:21.142202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:21.149914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2d2a8210-a404-438a-beac-e25a2c7d57f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1249 microversion: 2.1 time: 0.080841 May 19 16:45:21.150402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 164/333] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:21 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:21.618711 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:21.619314 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:21.625936 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:21.626373 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:21.627119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:21.627553 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:21.760717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:21.770085 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ad50f789-73c2-431e-a8bc-6debeb78be1d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.155262 May 19 16:45:21.770651 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 170/334] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:21 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:22.167565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:22.168168 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:22.174806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:22.175245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:22.175996 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:22.176425 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:22.235054 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:22.242913 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9685e095-80b9-4511-9603-024451d84a35 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1249 microversion: 2.1 time: 0.079539 May 19 16:45:22.243470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 165/335] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:22 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1249 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:22.787284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:22.788305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:22.794999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:22.795454 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:22.796212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:22.796643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:22.935495 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:22.943395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e01aa3b2-6cee-46d3-926b-d916e54fbd83 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.160536 May 19 16:45:22.943964 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 171/336] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:22 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:23.260155 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:23.260756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:23.266935 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:23.267359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:23.268572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:23.268572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:23.329353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:23.336772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cd4e6c19-2438-46b4-8ed4-63b7887f75bd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1249 microversion: 2.1 time: 0.080473 May 19 16:45:23.337371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 166/337] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:23 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:23.959940 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:23.960795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:23.967706 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:23.968661 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:23.969102 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:23.969719 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:24.151218 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:24.159146 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-243fb0bc-27d4-431a-931b-ebabe26e61e8 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.202580 May 19 16:45:24.159705 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 172/338] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:23 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:24.353629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:24.354245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:24.360398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:24.360899 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:24.361855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:24.362508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:24.427915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:24.435932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f33bd1a0-0e3b-4543-91cc-a62e392c2ebe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1305 microversion: 2.1 time: 0.086108 May 19 16:45:24.445464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 167/339] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:24 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1305 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:24.620510 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-88fde6b5-22c2-4233-9bb1-1a0dbb336844 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3f74bce1-8839-4ef5-96a4-6881ec16abe5", "device": "/dev/sdb"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:24.622265 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-88fde6b5-22c2-4233-9bb1-1a0dbb336844 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:24.629528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88fde6b5-22c2-4233-9bb1-1a0dbb336844 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:24.630094 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88fde6b5-22c2-4233-9bb1-1a0dbb336844 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:24.630930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88fde6b5-22c2-4233-9bb1-1a0dbb336844 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:24.631426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88fde6b5-22c2-4233-9bb1-1a0dbb336844 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:24.900585 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-88fde6b5-22c2-4233-9bb1-1a0dbb336844 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "POST /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283933 May 19 16:45:24.901249 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 173/340] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:45:24 2022] POST /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:25.176348 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:25.177056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:25.183845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:25.184341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:25.185250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:25.185666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:25.323539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:25.331519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ee3f32c8-ed0b-44b5-9f02-421e5dc2bfb9 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.159015 May 19 16:45:25.332280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 168/341] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:25 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:25.454207 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:25.454819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:25.461846 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:25.462298 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:25.463205 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:25.463649 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:25.676427 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:25.686181 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ef2369b8-0f8f-4e30-af71-acf1c081cbbb tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.236321 May 19 16:45:25.696766 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 174/342] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:25 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:26.291397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-3e828103-cdbd-41c0-9d8b-b0858de3aaee req-5221bce8-b1ed-4198-a07e-d483fd10cc59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5", "tag": "dc7ca7c9-fb4e-427b-a711-3641b6dc9306"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:26.306761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3e828103-cdbd-41c0-9d8b-b0858de3aaee req-5221bce8-b1ed-4198-a07e-d483fd10cc59 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:26.307208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3e828103-cdbd-41c0-9d8b-b0858de3aaee req-5221bce8-b1ed-4198-a07e-d483fd10cc59 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:26.331218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-3e828103-cdbd-41c0-9d8b-b0858de3aaee req-5221bce8-b1ed-4198-a07e-d483fd10cc59 service nova] Creating event network-changed:dc7ca7c9-fb4e-427b-a711-3641b6dc9306 for instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 on hv-cinder-84243 May 19 16:45:26.339748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-3e828103-cdbd-41c0-9d8b-b0858de3aaee req-5221bce8-b1ed-4198-a07e-d483fd10cc59 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052700 May 19 16:45:26.343590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 169/343] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:26.348963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:26.349830 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:26.358838 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:26.359317 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:26.360106 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:26.360542 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:26.603995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:26.612279 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9eeaeb08-8004-42e7-9e9a-3a2abb0e80ab tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.266781 May 19 16:45:26.612852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 175/344] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:26 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:26.704406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:26.705396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:26.711781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:26.712234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:26.713033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:26.713504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:26.852874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:26.860376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4b2e8b21-e72e-46ed-a482-dbe8e9a583d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.160194 May 19 16:45:26.860933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 170/345] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:26 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:27.630317 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:27.630926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:27.637436 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:27.637881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:27.638644 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:27.639064 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:27.770962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:27.778416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-77b1eb9e-187e-4d26-97f1-37150c43cdee tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.152836 May 19 16:45:27.778988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 176/346] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:27 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:27.877739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:27.878346 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:27.884706 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:27.885166 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:27.885869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:27.886297 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:28.020080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:28.027502 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-45c4a397-fbbe-4081-bca5-bc8fb265d27e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.153579 May 19 16:45:28.028057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 171/347] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:27 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:28.659873 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-753c5e5b-ea8a-4793-9e7a-d1eccb2892c0 req-c4704479-3827-4c4a-b906-bfe36e6cd880 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3", "name": "network-vif-plugged", "status": "completed", "tag": "b4a3f8c2-04a8-493f-8d32-a89878ded8a5"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:28.669449 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-753c5e5b-ea8a-4793-9e7a-d1eccb2892c0 req-c4704479-3827-4c4a-b906-bfe36e6cd880 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:28.669899 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-753c5e5b-ea8a-4793-9e7a-d1eccb2892c0 req-c4704479-3827-4c4a-b906-bfe36e6cd880 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:28.681763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-753c5e5b-ea8a-4793-9e7a-d1eccb2892c0 req-c4704479-3827-4c4a-b906-bfe36e6cd880 service nova] Creating event network-vif-plugged:b4a3f8c2-04a8-493f-8d32-a89878ded8a5 for instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 on hv-cinder-84243 May 19 16:45:28.686940 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-753c5e5b-ea8a-4793-9e7a-d1eccb2892c0 req-c4704479-3827-4c4a-b906-bfe36e6cd880 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031264 May 19 16:45:28.687509 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 177/348] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:45:28.795297 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:28.795841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:28.802702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:28.803154 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:28.803925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:28.804360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:28.933537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:28.941109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c6ed2dc1-8c98-409d-a46c-aa16fce19fc4 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.149819 May 19 16:45:28.941691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 172/349] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:28 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:29.045538 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:29.046140 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:29.052605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:29.053058 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:29.053863 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:29.054303 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:29.191618 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:29.199375 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f8f77b98-2006-40dc-9d44-51ad91ef8461 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.158032 May 19 16:45:29.199849 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 178/350] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:29 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:29.957822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:29.958613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:29.964903 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:29.965396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:29.966157 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:29.966588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:30.053635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:30.105604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:30.112962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4b2f9191-ab84-4f73-93b7-71de601a0499 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.159821 May 19 16:45:30.113557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 173/351] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:29 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:30.215653 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:30.216072 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:30.218531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:30.219172 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=14 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:30.225145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:30.225628 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:30.226398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:30.226827 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:30.360901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:30.369419 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-81ed9137-afd8-423e-9f48-c6d74ac889a7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.157616 May 19 16:45:30.370005 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 179/352] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:30 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:31.130133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:31.130733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:31.136713 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:31.137171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:31.137934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:31.138361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:31.266132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:31.273746 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c83b5542-0684-4942-a091-d63cad85d888 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1314 microversion: 2.1 time: 0.147905 May 19 16:45:31.274305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 174/353] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:31 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:31.386996 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:31.387630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:31.389928 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=6 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:31.395426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:31.395877 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:31.396637 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:31.397069 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:31.412480 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:31.532261 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:31.540280 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d5342094-927a-4fa6-aa20-393b85edc0c6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.157054 May 19 16:45:31.540856 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 180/354] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:31 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:32.291028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:32.291629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:32.294627 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:32.298669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.299768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.300547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.301019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.445450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:32.452991 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f78ead18-6581-49ab-a6af-b7c83a9e1e48 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1463 microversion: 2.1 time: 0.166098 May 19 16:45:32.453649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 175/355] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:32 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1463 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:32.494469 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:32.495192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:32.503019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.503528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.504945 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.505569 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.536816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:45:32.558713 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:32.560088 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:32.570330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.570864 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.572739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.573215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.636323 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-73fe0f6c-c5ef-4be3-a736-d0583e96805e tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 204 len: 0 microversion: 2.1 time: 0.146919 May 19 16:45:32.639934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 181/356] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:45:32 2022] DELETE /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:45:32.647055 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:32.647165 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:32.654450 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.654899 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.655662 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:32.656092 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:32.778113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:32.787722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-09924d56-4c9b-4e4d-9d42-2fa3ff8666ba tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.234326 May 19 16:45:32.789035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 176/357] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:32 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:32.825809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:32.834724 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-84329d82-177d-4678-8058-42e0972628d2 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1469 microversion: 2.1 time: 0.193396 May 19 16:45:32.835329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 182/358] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:32 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1469 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:33.805490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:33.806095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:33.812157 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:33.812603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:33.813388 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:33.813821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:33.852091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:33.852696 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:33.859098 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:33.859929 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:33.860707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:33.862854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:33.951427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:33.959027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-49d970a1-852f-4261-9517-5d92f86e17b6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.157299 May 19 16:45:33.959830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 177/359] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:33 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:33.996750 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:34.004480 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cba1cf4e-a5b8-49d1-9fb4-d6299ac5d177 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1469 microversion: 2.1 time: 0.156121 May 19 16:45:34.005037 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 183/360] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:33 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:34.975821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:34.976435 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:34.982651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:34.983107 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:34.983875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:34.984322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:34.988794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:35.021095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:35.021758 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:35.028402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:35.028847 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:35.029624 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:35.030054 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:35.118394 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:35.125809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f303c637-ba87-4d85-9a9a-b30674544f85 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.153768 May 19 16:45:35.126379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 178/361] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:34 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:35.160920 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:35.168339 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f9511156-f82b-4765-8689-35b28c7bb029 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1469 microversion: 2.1 time: 0.151014 May 19 16:45:35.168895 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 184/362] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:35 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:36.143885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:36.144491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:36.150558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:36.150998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:36.151751 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:36.152184 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:36.186348 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:36.186966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:36.193578 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:36.194033 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:36.194807 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:36.195241 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:36.286919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:36.294474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1fe67130-7ddf-4389-9203-1c6e763e6f22 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.154923 May 19 16:45:36.295054 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 179/363] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:36 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:36.330710 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:36.338263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-770ee2ff-0ee5-48df-a309-683e4cc28b8c tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1469 microversion: 2.1 time: 0.156121 May 19 16:45:36.338831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 185/364] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:36 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:37.311317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:37.311958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:37.318929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:37.319411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:37.320157 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:37.320602 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:37.355694 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:37.356398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:37.363795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:37.364327 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:37.365211 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:37.365716 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:37.449988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:37.457515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67cf83d4-d507-4458-90b0-576f00f6f425 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.149997 May 19 16:45:37.458318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 180/365] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:37 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:37.498606 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:37.506303 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-77da056e-28a4-4afe-a789-6d95413da9ae tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1469 microversion: 2.1 time: 0.154428 May 19 16:45:37.506867 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 186/366] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:37 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:38.474392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:38.475031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:38.481072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:38.481547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:38.482306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:38.482742 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:38.523608 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:38.524224 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:38.530825 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:38.531271 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:38.532105 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:38.532460 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:38.619066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:38.626560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-93798222-4183-4e5a-92a0-15dd811932b0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.156073 May 19 16:45:38.627695 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 181/367] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:38 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:38.776780 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:38.784371 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e88bc5ce-c6e4-4284-8a2f-774b94cc24bf tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1469 microversion: 2.1 time: 0.264897 May 19 16:45:38.785051 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 187/368] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:38 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1469 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:39.114381 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-329070a8-cbb2-4c15-a104-168d95534b1d req-0d46087f-4128-4486-ab39-9ac7bad1feaa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3", "name": "network-vif-deleted", "tag": "b4a3f8c2-04a8-493f-8d32-a89878ded8a5"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:39.122919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-329070a8-cbb2-4c15-a104-168d95534b1d req-0d46087f-4128-4486-ab39-9ac7bad1feaa service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:39.123623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-329070a8-cbb2-4c15-a104-168d95534b1d req-0d46087f-4128-4486-ab39-9ac7bad1feaa service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:39.137745 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-329070a8-cbb2-4c15-a104-168d95534b1d req-0d46087f-4128-4486-ab39-9ac7bad1feaa service nova] Creating event network-vif-deleted:b4a3f8c2-04a8-493f-8d32-a89878ded8a5 for instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 on hv-cinder-84243 May 19 16:45:39.164290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-329070a8-cbb2-4c15-a104-168d95534b1d req-0d46087f-4128-4486-ab39-9ac7bad1feaa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054044 May 19 16:45:39.168212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-77bcbea4-cb66-420a-a234-8f7a8f469afb req-6e9aada0-617f-48d0-b573-0e0a073b114e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5", "name": "network-vif-plugged", "status": "completed", "tag": "dc7ca7c9-fb4e-427b-a711-3641b6dc9306"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:39.169405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 182/369] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:39.187071 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-77bcbea4-cb66-420a-a234-8f7a8f469afb req-6e9aada0-617f-48d0-b573-0e0a073b114e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:39.187631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-77bcbea4-cb66-420a-a234-8f7a8f469afb req-6e9aada0-617f-48d0-b573-0e0a073b114e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:39.200575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-77bcbea4-cb66-420a-a234-8f7a8f469afb req-6e9aada0-617f-48d0-b573-0e0a073b114e service nova] Creating event network-vif-plugged:dc7ca7c9-fb4e-427b-a711-3641b6dc9306 for instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 on hv-cinder-84243 May 19 16:45:39.206773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-77bcbea4-cb66-420a-a234-8f7a8f469afb req-6e9aada0-617f-48d0-b573-0e0a073b114e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044430 May 19 16:45:39.207707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 188/370] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:39.644926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:39.645653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:39.651880 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:39.652329 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:39.653088 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:39.653605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:39.785240 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:39.792801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-522a418b-e2bc-4f4e-8998-c90b1796c00e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.152609 May 19 16:45:39.793411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 183/371] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:39 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:39.802341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:39.803064 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:39.809316 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:39.809755 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:39.810507 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:39.810936 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:39.842681 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:39.843119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:39.843559 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lazy-loading 'fault' on Instance uuid b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:45:39.888970 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:39.897534 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c3bbcdc7-fa7c-4e4a-8384-e2f125cf838d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1304 microversion: 2.1 time: 0.099574 May 19 16:45:39.898060 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 189/372] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:39 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1304 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:40.810495 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:40.811022 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:40.817415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:40.817866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:40.818631 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:40.819065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:40.915210 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:40.915943 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:40.923118 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:40.923807 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:40.924403 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:40.924869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:40.972569 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:40.972963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:40.973453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lazy-loading 'fault' on Instance uuid b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:45:40.984533 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:40.999219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5948cf23-4082-4f28-93af-bb30c8e97b54 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.192285 May 19 16:45:41.000076 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 184/373] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:40 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:41.015810 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:41.024206 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e7f6a60b-09be-4e45-a8cc-5a80568a637d tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1304 microversion: 2.1 time: 0.112851 May 19 16:45:41.025169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 190/374] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:40 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:42.025406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:42.025998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:42.032135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:42.032584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:42.034212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:42.034722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:42.041710 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:42.042323 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:42.049949 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:42.050399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:42.051178 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:42.051605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:42.087292 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:42.087748 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:42.088196 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lazy-loading 'fault' on Instance uuid b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:45:42.135429 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:42.144053 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-948c2a19-532d-4444-8423-b936f9e9c7dc tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1304 microversion: 2.1 time: 0.105985 May 19 16:45:42.144947 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 191/375] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:42 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:42.185507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:42.193268 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e1f75826-d7f0-4fa7-b2e0-6a65b5c8b285 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.171642 May 19 16:45:42.193843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 185/376] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:42 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:43.161378 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:43.161949 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:43.168608 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:43.169060 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:43.169861 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:43.170305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:43.203889 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:43.204341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:43.204888 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lazy-loading 'fault' on Instance uuid b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:45:43.209869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:43.210485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:43.217083 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:43.217525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:43.218310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:43.218745 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:43.249286 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1d0fe4ce272e46509e8b744e17664ccd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c7652596e3b41d285e874ca1a675677', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:43.257997 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-829dee0e-0170-48b1-9ba1-a815a8789fa1 tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 200 len: 1304 microversion: 2.1 time: 0.100534 May 19 16:45:43.258565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 192/377] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:43 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 1304 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:43.363474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:43.371075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-235833b1-9172-45c4-b170-fe747994ec5a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.164964 May 19 16:45:43.371650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 186/378] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:43 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:44.274974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:44.275587 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] [instance: b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:44.282221 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:44.282676 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:44.283441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:44.283881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:44.297843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] HTTP exception thrown: Instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 could not be found. May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Request method failure captured: May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 HTTP/1.1 May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnQXQbSJT_kETUP0niBEquK-qskzaWiawSFqk5DIF73ikL_YbGC9Yohely5vhbPEP-IaYgJoFKW6LEBgR_XKBL5H4AIwmnMwY5gp-AfWXww5YoXnzliMqY1UHU6Fdtq_dD5l9BT4M6yH4u9YdhXy96CSzvtIgQvCGgtws0I4kaiXCZ8 May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 6c7652596e3b41d285e874ca1a675677 May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesNegativeTest-128414571 May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:45:44.299586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/6c7652596e3b41d285e874ca1a675677"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c7652596e3b41d285e874ca1a675677"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_6c7652596e3b41d285e874ca1a675677", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/6c7652596e3b41d285e874ca1a675677"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesNegativeTest-128414571 May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 6c7652596e3b41d285e874ca1a675677 May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesNegativeTest-128414571 May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesNegativeTest-128414571-project May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 1d0fe4ce272e46509e8b744e17664ccd May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesNegativeTest-128414571-project May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 could not be found. May 19 16:45:44.301426 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3'} May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 could not be found. May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:45:44.302312 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 could not be found. May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 could not be found. May 19 16:45:44.303565 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:45:44.304934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] Returning 404 to user: Instance b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:45:44.304934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-38f0496d-28fd-48b0-99cd-8b6906929acd tempest-VolumesNegativeTest-128414571 tempest-VolumesNegativeTest-128414571-project] 10.222.0.36 "GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3" status: 404 len: 111 microversion: 2.1 time: 0.029824 May 19 16:45:44.304934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 193/379] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:44 2022] GET /compute/v2.1/servers/b2c1b91d-6d7e-45ca-bc0e-b6f4e2c70fb3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:45:44.387940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:44.388472 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:44.395374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:44.395980 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:44.396767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:44.397272 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:44.567429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:44.575418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cbfed070-ba55-4ecf-a5ed-a7d147aed4ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.191344 May 19 16:45:44.576106 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 187/380] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:44 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:45.593043 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:45.593892 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:45.601680 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:45.602135 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:45.602911 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:45.603357 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:45.756253 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:45.764336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ff54f3ec-022f-4da0-8649-063871665232 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.175095 May 19 16:45:45.765054 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 194/381] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:45 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:46.784006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:46.784619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:46.791176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:46.791668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:46.792467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:46.792900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:46.941098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:46.948744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fe5b6bf0-e2a4-4fbe-b6da-e641bc53dda1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.169146 May 19 16:45:46.949414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 188/382] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:46 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:47.966303 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:47.966916 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:47.973587 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:47.974042 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:47.974815 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:47.975282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:47.990376 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:45:48.108188 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:48.115669 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-219d41da-7a32-4706-b382-3963b5aa153c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.153178 May 19 16:45:48.116229 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 195/383] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:47 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:49.132330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:49.132933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:49.139236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:49.139801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:49.140567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:49.140998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:49.274504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:49.284392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cd97d68f-9145-4970-ab34-c6118761c0da tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.155937 May 19 16:45:49.285243 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 189/384] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:49 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:50.304524 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:50.305059 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:50.311692 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:50.312170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:50.312924 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:50.313387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:50.445074 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:50.452551 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-54859c4f-c953-4e75-902e-7bfb9ec1f9f0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1371 microversion: 2.1 time: 0.151934 May 19 16:45:50.453109 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 196/385] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:50 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:51.469139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:51.469764 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:51.476777 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:51.477248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:51.478957 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:51.478957 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:51.623758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:51.633857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0cbe0e5c-d961-4296-b7db-206b5d89e10c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1565 microversion: 2.1 time: 0.168418 May 19 16:45:51.645585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 190/386] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:51 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1565 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:51.654361 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fd3c35f6-55c9-4e9d-ab93-597349b2b27a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:51.654954 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fd3c35f6-55c9-4e9d-ab93-597349b2b27a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:51.665500 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd3c35f6-55c9-4e9d-ab93-597349b2b27a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:51.665500 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd3c35f6-55c9-4e9d-ab93-597349b2b27a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:51.665500 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd3c35f6-55c9-4e9d-ab93-597349b2b27a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:51.666078 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fd3c35f6-55c9-4e9d-ab93-597349b2b27a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:51.748584 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fd3c35f6-55c9-4e9d-ab93-597349b2b27a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.100996 May 19 16:45:51.749263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 197/387] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:45:51 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-interface => generated 285 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:53.007543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-eba6a924-1681-4522-92b9-8f81e897af6f req-c572e367-833f-427f-b376-de0a9f29497b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5", "tag": "dc7ca7c9-fb4e-427b-a711-3641b6dc9306"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:53.015643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-eba6a924-1681-4522-92b9-8f81e897af6f req-c572e367-833f-427f-b376-de0a9f29497b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:53.016168 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-eba6a924-1681-4522-92b9-8f81e897af6f req-c572e367-833f-427f-b376-de0a9f29497b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:53.028228 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-eba6a924-1681-4522-92b9-8f81e897af6f req-c572e367-833f-427f-b376-de0a9f29497b service nova] Creating event network-changed:dc7ca7c9-fb4e-427b-a711-3641b6dc9306 for instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 on hv-cinder-84243 May 19 16:45:53.034591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-eba6a924-1681-4522-92b9-8f81e897af6f req-c572e367-833f-427f-b376-de0a9f29497b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030736 May 19 16:45:53.035277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 191/388] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:45:54.907532 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:54.908726 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:54.916846 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:54.917384 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:54.918216 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:54.918767 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:55.067826 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lazy-loading 'services' on Instance uuid 362a1562-ca96-486a-94a2-02c7eb3a8c4d {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:45:55.190945 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8be34543-7563-49a6-8035-a3938d89fb09 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "DELETE /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d/os-volume_attachments/3f74bce1-8839-4ef5-96a4-6881ec16abe5" status: 202 len: 0 microversion: 2.1 time: 0.287762 May 19 16:45:55.191581 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 198/389] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:45:54 2022] DELETE /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d/os-volume_attachments/3f74bce1-8839-4ef5-96a4-6881ec16abe5 => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:45:56.313145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:56.313754 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:56.320013 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:56.320460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:56.321251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:56.321684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:56.346249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:45:56.436794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3fac100c-1b61-4524-833d-88618b407c61 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "DELETE /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 204 len: 0 microversion: 2.1 time: 0.127486 May 19 16:45:56.437416 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 192/390] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:45:56 2022] DELETE /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:45:56.446839 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:56.447539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:56.453975 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:56.454408 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:56.455173 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:56.455607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:56.586978 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:56.594556 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-866c01e4-7060-4c97-b082-3f9e92576bd8 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1513 microversion: 2.1 time: 0.152462 May 19 16:45:56.595723 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 199/391] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:56 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1513 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:45:57.612814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:57.613533 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:57.619595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:57.620018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:57.620771 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:57.621230 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:57.750587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:57.758291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a719563b-4b65-479c-a73f-ab7231d2535e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1513 microversion: 2.1 time: 0.150309 May 19 16:45:57.758852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 193/392] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:57 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1513 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:58.775146 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:45:58.775868 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:45:58.782393 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:58.782858 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:58.783622 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:58.784055 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:58.977890 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:45:58.986049 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e5e8ea11-427c-4864-a727-2327e4c25151 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 200 len: 1513 microversion: 2.1 time: 0.214249 May 19 16:45:58.986605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 200/393] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:58 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 1513 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:45:59.128529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-d5e60d6c-e7e4-45b1-a6be-7fb8580a7e54 req-b208a395-87e2-4b09-9f81-0c828e696d0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "362a1562-ca96-486a-94a2-02c7eb3a8c4d", "name": "network-vif-deleted", "tag": "ab12d705-4be6-4560-914e-9c3166275d2d"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:45:59.137736 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d5e60d6c-e7e4-45b1-a6be-7fb8580a7e54 req-b208a395-87e2-4b09-9f81-0c828e696d0e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:45:59.138134 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d5e60d6c-e7e4-45b1-a6be-7fb8580a7e54 req-b208a395-87e2-4b09-9f81-0c828e696d0e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:45:59.150305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-d5e60d6c-e7e4-45b1-a6be-7fb8580a7e54 req-b208a395-87e2-4b09-9f81-0c828e696d0e service nova] Creating event network-vif-deleted:ab12d705-4be6-4560-914e-9c3166275d2d for instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d on hv-cinder-84243 May 19 16:45:59.155155 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-d5e60d6c-e7e4-45b1-a6be-7fb8580a7e54 req-b208a395-87e2-4b09-9f81-0c828e696d0e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030603 May 19 16:45:59.155751 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 194/394] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:45:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:00.002657 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:00.003534 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 362a1562-ca96-486a-94a2-02c7eb3a8c4d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:00.010255 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:00.010707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:00.011471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:00.011905 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:00.025797 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] HTTP exception thrown: Instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d could not be found. May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Request method failure captured: May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d HTTP/1.1 May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnPk4bDK0XSWgCviILbdwAv9isItwazNaWjdYh9r-9AeM2vbMR4B9mI2PLH6o7QIHh8MGdWtbagyBmkebCR4wHzy4G3XQSJwPLmc1jQ_9YTQe4OJvlHGHeFaARUAgG0Bsa8ssrKK0vWhoFkwj-BoSk7JqW8hysQv2XEE2fYmPVypixE May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3cee796edf9b42538358459363ea24ca May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-VolumesSnapshotTestJSON-939277591 May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:46:00.027437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3cee796edf9b42538358459363ea24ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3cee796edf9b42538358459363ea24ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3cee796edf9b42538358459363ea24ca", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3cee796edf9b42538358459363ea24ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-VolumesSnapshotTestJSON-939277591 May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3cee796edf9b42538358459363ea24ca May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-939277591 May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-VolumesSnapshotTestJSON-939277591-project May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: e9c52d463394487d94e55aed8c44068a May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-VolumesSnapshotTestJSON-939277591-project May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d could not be found. May 19 16:46:00.029032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': '362a1562-ca96-486a-94a2-02c7eb3a8c4d'} May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d could not be found. May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:46:00.029926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d could not be found. May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d could not be found. May 19 16:46:00.031329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:46:00.032639 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Returning 404 to user: Instance 362a1562-ca96-486a-94a2-02c7eb3a8c4d could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:46:00.032639 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-272b2dd5-e5fa-42a7-a9b1-81e338efcdb5 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d" status: 404 len: 111 microversion: 2.1 time: 0.030574 May 19 16:46:00.032639 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 201/395] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:45:59 2022] GET /compute/v2.1/servers/362a1562-ca96-486a-94a2-02c7eb3a8c4d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:46:11.980261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=44,nova_api:UPDATE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:11.981080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:11.985768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-2060932936", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "networks": [{"uuid": "3d757d63-7d26-43b7-b546-eb7adc1b7dc9"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:12.038369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] validate_networks() for [('3d757d63-7d26-43b7-b546-eb7adc1b7dc9', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:46:12.375466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:46:12.375890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:46:12.376373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:46:12.376821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:46:12.377266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:46:12.386395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:12.386845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:12.387638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:12.388077 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:12.405564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Getting quotas for project 3cee796edf9b42538358459363ea24ca. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:46:12.410026 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Getting quotas for user e9c52d463394487d94e55aed8c44068a and project 3cee796edf9b42538358459363ea24ca. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:46:12.420811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:46:12.423168 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:46:12.466360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b1c99ccc-55a8-45d6-b498-2a20e8dee7df tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487138 May 19 16:46:12.467005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 195/396] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:46:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:46:12.475123 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:12.476496 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:12.481062 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7c057903-efb1-4336-b375-3aa18a6dda3e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:12.481715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7c057903-efb1-4336-b375-3aa18a6dda3e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:12.539770 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7c057903-efb1-4336-b375-3aa18a6dda3e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:12.546492 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7c057903-efb1-4336-b375-3aa18a6dda3e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1219 microversion: 2.1 time: 0.072931 May 19 16:46:12.547048 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 202/397] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:12 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:13.563431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:13.564306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:13.571271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:13.571727 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:13.572656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:13.573246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:13.640137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:13.647645 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-021d24f4-c757-40dc-9894-8af2ec53078c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1277 microversion: 2.1 time: 0.088274 May 19 16:46:13.648211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 196/398] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:13 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1277 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:14.664859 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:14.665527 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:14.673196 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:14.673651 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:14.674962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:14.675399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:14.800308 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-70c1887b-8bc8-47ce-9438-431703a6312f req-9abf614a-799d-4de1-847c-de3b346f7a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "67925afb-eca4-42e2-8d18-d06679d8a9dc", "tag": "cdf874f4-e0b9-4a4f-a5d5-24593a3b9dee"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:14.809656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-70c1887b-8bc8-47ce-9438-431703a6312f req-9abf614a-799d-4de1-847c-de3b346f7a5e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:14.810168 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-70c1887b-8bc8-47ce-9438-431703a6312f req-9abf614a-799d-4de1-847c-de3b346f7a5e service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:14.834623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-70c1887b-8bc8-47ce-9438-431703a6312f req-9abf614a-799d-4de1-847c-de3b346f7a5e service nova] Creating event network-changed:cdf874f4-e0b9-4a4f-a5d5-24593a3b9dee for instance 67925afb-eca4-42e2-8d18-d06679d8a9dc on hv-cinder-84243 May 19 16:46:14.840457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-70c1887b-8bc8-47ce-9438-431703a6312f req-9abf614a-799d-4de1-847c-de3b346f7a5e service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044047 May 19 16:46:14.841588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 197/399] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:46:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:14.920232 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:14.928201 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-30c34d67-7352-4126-9634-e2e2d9e1b83b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.267306 May 19 16:46:14.929077 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 203/400] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:14 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:46:15.946209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:15.946900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:15.953088 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:15.953563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:15.954314 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:15.954747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:16.086597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:16.093983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b0fb4e3b-0242-468c-8c43-f6c015d08032 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.151914 May 19 16:46:16.094538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 198/401] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:15 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:17.111409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:17.112130 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:17.119127 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:17.119578 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:17.120336 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:17.120773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:17.252323 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:17.260046 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9f981d2d-5644-4834-805f-36a8e0b77d20 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.152660 May 19 16:46:17.260610 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 204/402] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:17 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:18.276848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:18.277424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:18.283506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:18.283958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:18.284728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:18.285170 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:18.419993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:18.427968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f5538213-2f3c-462b-8b93-c086d0bed599 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.155035 May 19 16:46:18.428535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 199/403] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:18 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:19.444626 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:19.445345 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:19.452558 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:19.452999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:19.453789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:19.454219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:19.581836 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:19.589243 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f4222612-86ef-464b-8023-02c203a800e7 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.148515 May 19 16:46:19.589762 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 205/404] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:19 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:20.606809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:20.607419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:20.614025 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-6a4ee88e-4326-4c92-8f74-ea4a97d072d7 req-004a4608-2577-454e-99fb-ed50c2fbcd6b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67925afb-eca4-42e2-8d18-d06679d8a9dc", "name": "network-vif-plugged", "status": "completed", "tag": "cdf874f4-e0b9-4a4f-a5d5-24593a3b9dee"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:20.614528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:20.614639 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:20.615335 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:20.615780 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:20.624125 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-6a4ee88e-4326-4c92-8f74-ea4a97d072d7 req-004a4608-2577-454e-99fb-ed50c2fbcd6b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:20.624804 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-6a4ee88e-4326-4c92-8f74-ea4a97d072d7 req-004a4608-2577-454e-99fb-ed50c2fbcd6b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:20.640526 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-6a4ee88e-4326-4c92-8f74-ea4a97d072d7 req-004a4608-2577-454e-99fb-ed50c2fbcd6b service nova] Creating event network-vif-plugged:cdf874f4-e0b9-4a4f-a5d5-24593a3b9dee for instance 67925afb-eca4-42e2-8d18-d06679d8a9dc on hv-cinder-84243 May 19 16:46:20.646131 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-6a4ee88e-4326-4c92-8f74-ea4a97d072d7 req-004a4608-2577-454e-99fb-ed50c2fbcd6b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036462 May 19 16:46:20.646999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 206/405] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:46:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:46:20.771679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:20.780216 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-117ba3b7-73e9-4b88-ad88-cc00bc6af527 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.177563 May 19 16:46:20.780811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 200/406] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:20 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:21.798587 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:21.799289 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:21.806212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:21.806658 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:21.807414 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:21.807851 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:21.939000 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:21.946397 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bc735f2a-51cd-4cf0-bb55-0da17818b42e tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.152523 May 19 16:46:21.946952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 207/407] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:21 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:22.963258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:22.963869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:22.965860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:22.966510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:22.973243 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:22.973695 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:22.974456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:22.974895 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:23.104219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:23.111573 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ec3563eb-9ec3-48d9-a68c-7bf495464875 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1319 microversion: 2.1 time: 0.152153 May 19 16:46:23.112132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 201/408] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:22 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1319 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:24.128438 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:24.129114 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:24.131568 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:24.137079 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:24.137548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:24.138304 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:24.138734 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:24.269806 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:24.277842 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-10d5cf42-3989-4fd5-b3aa-d7fa6605a671 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1508 microversion: 2.1 time: 0.153448 May 19 16:46:24.278416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 208/409] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:24 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:24.297292 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5b277b25-a85f-4936-9b0f-caabdc271fc2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1c0db530-e2ef-4b1e-b1c6-897051c2496b", "device": "/dev/sdb"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:24.298890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5b277b25-a85f-4936-9b0f-caabdc271fc2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:24.305252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b277b25-a85f-4936-9b0f-caabdc271fc2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:24.305704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b277b25-a85f-4936-9b0f-caabdc271fc2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:24.306482 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b277b25-a85f-4936-9b0f-caabdc271fc2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:24.306920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b277b25-a85f-4936-9b0f-caabdc271fc2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:24.575387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5b277b25-a85f-4936-9b0f-caabdc271fc2 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "POST /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281963 May 19 16:46:24.575979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 202/410] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:46:24 2022] POST /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:30.629934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-81316044-aca2-40ee-9044-2bb8d4822886 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:30.630552 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-81316044-aca2-40ee-9044-2bb8d4822886 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:30.637449 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81316044-aca2-40ee-9044-2bb8d4822886 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:30.637906 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81316044-aca2-40ee-9044-2bb8d4822886 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:30.638678 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81316044-aca2-40ee-9044-2bb8d4822886 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:30.639119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-81316044-aca2-40ee-9044-2bb8d4822886 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:30.663524 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-81316044-aca2-40ee-9044-2bb8d4822886 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/ips" status: 200 len: 149 microversion: 2.1 time: 0.037835 May 19 16:46:30.664109 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 209/411] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:46:30 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:32.032584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-37e49cfe-5892-4f82-9dd3-76c9500794be tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31369114-8f46-44f6-8fa8-037b1672c95e"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:32.033816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-37e49cfe-5892-4f82-9dd3-76c9500794be tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:32.041447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37e49cfe-5892-4f82-9dd3-76c9500794be tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:32.041897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37e49cfe-5892-4f82-9dd3-76c9500794be tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:32.042683 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37e49cfe-5892-4f82-9dd3-76c9500794be tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:32.043120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37e49cfe-5892-4f82-9dd3-76c9500794be tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:32.312677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-37e49cfe-5892-4f82-9dd3-76c9500794be tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.284635 May 19 16:46:32.313302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 203/412] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:46:32 2022] POST /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:40.334384 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-715a1bd0-30b3-40b5-9ab4-b58a01715e80 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:40.334956 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-715a1bd0-30b3-40b5-9ab4-b58a01715e80 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:40.341416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715a1bd0-30b3-40b5-9ab4-b58a01715e80 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:40.341862 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715a1bd0-30b3-40b5-9ab4-b58a01715e80 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:40.342604 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715a1bd0-30b3-40b5-9ab4-b58a01715e80 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:40.343029 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715a1bd0-30b3-40b5-9ab4-b58a01715e80 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:40.365404 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-715a1bd0-30b3-40b5-9ab4-b58a01715e80 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/ips" status: 200 len: 152 microversion: 2.20 time: 0.035481 May 19 16:46:40.365963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 210/413] 10.222.0.36 () {60 vars in 1288 bytes} [Thu May 19 16:46:40 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/ips => generated 152 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:46:45.388134 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:45.388905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:45.393478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:45.394181 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:45.401916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:45.402371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:45.403141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:45.403575 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:45.430668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lazy-loading 'flavor' on Instance uuid 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:46:45.742561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7535d6b3-2495-456f-9cf5-ab1d070a72c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/action" status: 202 len: 0 microversion: 2.20 time: 0.355867 May 19 16:46:45.743251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 204/414] 10.222.0.36 () {62 vars in 1318 bytes} [Thu May 19 16:46:45 2022] POST /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/action => generated 0 bytes in 358 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 16:46:45.752899 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:45.753652 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:45.756149 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=21 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:45.761239 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:45.762043 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:45.763203 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:45.763843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:45.769709 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=41 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:45.914283 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:45.922241 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:45.923818 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:45.924929 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bee7da61-abfc-4087-831d-c8096af4a359 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.176546 May 19 16:46:45.925820 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 211/415] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:45 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:46:46.164595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bc58901f-f64d-4192-aff9-d72a5d429c95 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: .version_select at 0x7f48937c04c0>, body: {"keypair": {"name": "tempest-keypair-816525665", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpLQcRNIUPMnQu+04S/BAQPF5STETPFKm/9o2GmbPCJUYJywW7aKpuOG7R7ew6O123dN8ZTb0lcdx2TdxPR132hcti+llRjEKygiQdT3+2mrhxUgjd0xB7AQK29Q8aiww=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:46.179937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-bc58901f-f64d-4192-aff9-d72a5d429c95 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:46:46.183765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-bc58901f-f64d-4192-aff9-d72a5d429c95 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:46:46.207517 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bc58901f-f64d-4192-aff9-d72a5d429c95 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.048357 May 19 16:46:46.208131 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 205/416] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:46:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:46.944956 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:46.946347 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:46.954239 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:46.954700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:46.955952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:46.956417 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:47.446107 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:47.457377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:47.460148 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:47.462074 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4c940fbb-b485-4618-b6ca-4c5bd2a1161c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.522376 May 19 16:46:47.462885 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 212/417] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:46 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:46:47.909277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1305548685", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84ed37a0-33b7-474f-8c60-1eac20f29b87"}], "security_groups": [{"name": "tempest-securitygroup--669595675"}], "key_name": "tempest-keypair-816525665", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:48.020291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] validate_networks() for [('84ed37a0-33b7-474f-8c60-1eac20f29b87', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:46:48.047643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:48.048212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:48.054680 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:48.055126 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:48.055899 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:48.056332 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:48.147571 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lazy-loading 'services' on Instance uuid 67925afb-eca4-42e2-8d18-d06679d8a9dc {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:46:48.226734 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4f12b76a-b337-4cd6-a87f-f8c3a904827d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc/os-volume_attachments/1c0db530-e2ef-4b1e-b1c6-897051c2496b" status: 202 len: 0 microversion: 2.1 time: 0.183007 May 19 16:46:48.227900 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 213/418] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:46:48 2022] DELETE /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc/os-volume_attachments/1c0db530-e2ef-4b1e-b1c6-897051c2496b => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:46:48.466526 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:46:48.466952 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:46:48.467424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:46:48.467865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:46:48.468275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:46:48.478027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:48.478584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:48.479401 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:48.479909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:48.482306 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:48.483009 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:48.490181 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:48.490636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:48.491416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:48.491843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:48.499428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:46:48.504929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:46:48.518799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:46:48.521284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:46:48.581598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-81ee2f56-2c4e-4607-bacd-ad6577c67ac0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.676929 May 19 16:46:48.587472 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 206/419] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:46:47 2022] POST /compute/v2.1/servers => generated 401 bytes in 682 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:46:48.598082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-67632b37-a2c5-4119-b943-34a8c2c198b4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:48.599226 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-67632b37-a2c5-4119-b943-34a8c2c198b4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:48.676943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-67632b37-a2c5-4119-b943-34a8c2c198b4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:48.678318 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:48.684603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-67632b37-a2c5-4119-b943-34a8c2c198b4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1241 microversion: 2.1 time: 0.095529 May 19 16:46:48.685379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 207/420] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:48 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1241 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:48.693778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:48.695369 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:48.696677 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d5a40273-6de4-4814-a679-c77a1dd9e344 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.218995 May 19 16:46:48.697264 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 214/421] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:48 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:46:49.383989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:49.384781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:49.391438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.391884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.392660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.393096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.421946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:46:49.520173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9596adf3-be93-45b2-b474-b4952eaf3149 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "DELETE /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 204 len: 0 microversion: 2.1 time: 0.139919 May 19 16:46:49.520884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 208/422] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:46:49 2022] DELETE /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:46:49.531018 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:49.531670 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:49.538884 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.539330 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.540108 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.540540 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.692850 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:49.702804 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:49.703253 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-74a9a248-7c9d-47ee-9529-8fedeeb6ac90 tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1514 microversion: 2.1 time: 0.176930 May 19 16:46:49.703841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:49.704303 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 215/423] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:49 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:49.711613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.712782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.713015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.713514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.720821 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:49.722638 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:49.733260 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.733898 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.734857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:49.735581 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:49.780778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:49.790118 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-97364cb6-21e2-48bd-a0d6-2ce899459cc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1301 microversion: 2.1 time: 0.091854 May 19 16:46:49.790847 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 209/424] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:49 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1301 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:46:49.910025 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:49.918456 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:49.919965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:49.921128 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2b6b6f3a-38c3-4a65-86d7-fda9531a5ac2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.209394 May 19 16:46:49.921723 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 216/425] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:49 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:46:50.721795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:50.722399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:50.729006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:50.729487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:50.730259 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:50.730697 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:50.807939 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:50.808466 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:50.815309 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:50.815789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:50.816558 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:50.816991 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:50.877789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:50.885857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0cda4c26-d6c7-4988-8a96-28542ac1874c tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1514 microversion: 2.1 time: 0.167805 May 19 16:46:50.886623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 210/426] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:50 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:46:50.887253 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:50.897829 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-22ba0b5d-dc3a-46a8-b4cf-a75a25b30bdf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1301 microversion: 2.1 time: 0.093684 May 19 16:46:50.898438 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 217/427] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:50 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1301 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:46:50.939592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:50.940204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:50.947645 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:50.948021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:50.949020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:50.949720 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:51.086223 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:51.094244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:51.096195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:51.097443 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8aaad468-020a-499c-a3fa-49a1bacd9f05 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.161449 May 19 16:46:51.098001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 211/428] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:50 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:46:51.902722 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:51.903338 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:51.910548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:51.911012 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:51.911799 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:51.912234 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:51.915502 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:51.916116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:51.922254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:51.922703 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:51.927932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:51.928416 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:51.990791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:51.998345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-74cee888-1085-4a22-94e5-5b05e6ea0fa2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1299 microversion: 2.1 time: 0.087061 May 19 16:46:51.999106 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 212/429] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:51 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:52.121082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:52.121821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:52.128513 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:52.129053 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:52.129899 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:52.130471 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:52.201561 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:52.220014 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-64cc8297-9652-4cbd-8cdb-56298455d63d tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1514 microversion: 2.1 time: 0.320986 May 19 16:46:52.221207 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 218/430] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:51 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1514 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:52.278082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:52.286847 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:52.288384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:52.289921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-23979d6f-9eeb-4967-b453-be425a7ebd7e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.172346 May 19 16:46:52.300179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 213/431] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:52 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:46:52.965795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-d3d599f7-4a2e-451c-a759-956c7232b2dc req-ff3b81bd-b201-45a2-9170-47eb47990bb7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "67925afb-eca4-42e2-8d18-d06679d8a9dc", "name": "network-vif-deleted", "tag": "cdf874f4-e0b9-4a4f-a5d5-24593a3b9dee"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:52.974785 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d3d599f7-4a2e-451c-a759-956c7232b2dc req-ff3b81bd-b201-45a2-9170-47eb47990bb7 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:52.975228 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-d3d599f7-4a2e-451c-a759-956c7232b2dc req-ff3b81bd-b201-45a2-9170-47eb47990bb7 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:52.992192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-d3d599f7-4a2e-451c-a759-956c7232b2dc req-ff3b81bd-b201-45a2-9170-47eb47990bb7 service nova] Creating event network-vif-deleted:cdf874f4-e0b9-4a4f-a5d5-24593a3b9dee for instance 67925afb-eca4-42e2-8d18-d06679d8a9dc on hv-cinder-84243 May 19 16:46:52.996834 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-d3d599f7-4a2e-451c-a759-956c7232b2dc req-ff3b81bd-b201-45a2-9170-47eb47990bb7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034744 May 19 16:46:52.997979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 219/432] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:46:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:53.015568 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:53.016186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:53.023653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:53.024107 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:53.024881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:53.025536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:53.164867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:53.179761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dbc80e33-c024-4ac7-ac6f-c7bdf14ddb48 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.167984 May 19 16:46:53.180348 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 214/433] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:53 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:53.238306 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:53.239728 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:53.246169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:53.246634 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:53.247422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:53.247869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:53.286337 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:53.286941 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:53.287493 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lazy-loading 'fault' on Instance uuid 67925afb-eca4-42e2-8d18-d06679d8a9dc {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:46:53.306782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:53.307676 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:53.314105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:53.314561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:53.315465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:53.316625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:53.365422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9c52d463394487d94e55aed8c44068a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3cee796edf9b42538358459363ea24ca', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:53.374602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2c95c77c-3091-4445-b997-96f4f1b4ec2f tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 200 len: 1309 microversion: 2.1 time: 0.140520 May 19 16:46:53.387557 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 220/434] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:53 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 1309 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:53.507437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:53.519106 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:53.521393 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:53.523075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9f7ef668-cb74-4439-b8ae-876d9734942c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.220186 May 19 16:46:53.535003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 215/435] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:53 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:46:54.197139 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:54.197752 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:54.204152 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:54.204599 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:54.205387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:54.205822 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:54.335752 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:54.343180 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8ce5c7f4-f27b-4f3c-8ff5-f181c899678b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.150026 May 19 16:46:54.343728 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 221/436] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:54 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:54.392781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:54.393426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] [instance: 67925afb-eca4-42e2-8d18-d06679d8a9dc] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:54.400145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:54.400607 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:54.401514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:54.402005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:54.415778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] HTTP exception thrown: Instance 67925afb-eca4-42e2-8d18-d06679d8a9dc could not be found. May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Request method failure captured: May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc HTTP/1.1 May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnPk4bDK0XSWgCviILbdwAv9isItwazNaWjdYh9r-9AeM2vbMR4B9mI2PLH6o7QIHh8MGdWtbagyBmkebCR4wHzy4G3XQSJwPLmc1jQ_9YTQe4OJvlHGHeFaARUAgG0Bsa8ssrKK0vWhoFkwj-BoSk7JqW8hysQv2XEE2fYmPVypixE May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3cee796edf9b42538358459363ea24ca May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesSnapshotTestJSON-939277591 May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:46:54.417483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3cee796edf9b42538358459363ea24ca"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3cee796edf9b42538358459363ea24ca"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3cee796edf9b42538358459363ea24ca", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3cee796edf9b42538358459363ea24ca"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesSnapshotTestJSON-939277591 May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3cee796edf9b42538358459363ea24ca May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-939277591 May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesSnapshotTestJSON-939277591-project May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: e9c52d463394487d94e55aed8c44068a May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesSnapshotTestJSON-939277591-project May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 67925afb-eca4-42e2-8d18-d06679d8a9dc could not be found. May 19 16:46:54.419038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '67925afb-eca4-42e2-8d18-d06679d8a9dc'} May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 67925afb-eca4-42e2-8d18-d06679d8a9dc could not be found. May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:46:54.419902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 67925afb-eca4-42e2-8d18-d06679d8a9dc could not be found. May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 67925afb-eca4-42e2-8d18-d06679d8a9dc could not be found. May 19 16:46:54.421349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:46:54.422600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] Returning 404 to user: Instance 67925afb-eca4-42e2-8d18-d06679d8a9dc could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:46:54.422600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-143da595-1789-4dd7-a1ea-5efd750c6d8b tempest-VolumesSnapshotTestJSON-939277591 tempest-VolumesSnapshotTestJSON-939277591-project] 10.222.0.36 "GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc" status: 404 len: 111 microversion: 2.1 time: 0.029977 May 19 16:46:54.422600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 216/437] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:54 2022] GET /compute/v2.1/servers/67925afb-eca4-42e2-8d18-d06679d8a9dc => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:46:54.541398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:54.542322 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:54.548648 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:54.548908 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:54.549720 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:54.550231 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:54.700367 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:54.710330 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:54.711816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:54.713139 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-adf76bd5-254d-4651-9769-d5cb888fa110 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.175523 May 19 16:46:54.713884 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 222/438] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:54 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:46:55.014251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-3aac70fb-d86f-4735-afd8-b7273dd76035 req-4c23f550-0425-4a6d-bc71-bda11954eadc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b20a85-cbdd-4162-a605-e79b237afbb7", "tag": "7c85e1d9-2cb2-4a72-afa4-30d08738ec7f"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:46:55.022743 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3aac70fb-d86f-4735-afd8-b7273dd76035 req-4c23f550-0425-4a6d-bc71-bda11954eadc service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:55.023185 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3aac70fb-d86f-4735-afd8-b7273dd76035 req-4c23f550-0425-4a6d-bc71-bda11954eadc service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:55.034238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-3aac70fb-d86f-4735-afd8-b7273dd76035 req-4c23f550-0425-4a6d-bc71-bda11954eadc service nova] Creating event network-changed:7c85e1d9-2cb2-4a72-afa4-30d08738ec7f for instance 23b20a85-cbdd-4162-a605-e79b237afbb7 on hv-cinder-84243 May 19 16:46:55.038944 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-3aac70fb-d86f-4735-afd8-b7273dd76035 req-4c23f550-0425-4a6d-bc71-bda11954eadc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028310 May 19 16:46:55.039513 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 217/439] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:46:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:46:55.360060 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:55.360593 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:55.367625 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:55.368066 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:55.368809 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:55.369263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:55.498464 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:55.506141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c5f53bdf-d209-4128-9c8e-8ce8054e6507 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.150107 May 19 16:46:55.506702 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 223/440] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:55 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:55.733262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:55.733959 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:55.740765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:55.741246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:55.742012 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:55.742444 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:55.883382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:55.897536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:55.899556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:55.900953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cf85dd95-d4ba-4ea6-b3ae-31ea58672b45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.172356 May 19 16:46:55.901847 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 218/441] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:55 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:46:56.525780 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:56.526435 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:56.532920 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:56.533399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:56.534163 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:56.534598 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:56.669989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:56.677688 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-898684da-5744-4268-af78-32357831013b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.155879 May 19 16:46:56.678275 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 224/442] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:56 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:46:56.921255 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:56.921867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:56.929283 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:56.929729 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:56.930499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:56.930931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:57.065597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:57.074422 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:57.075866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:57.077036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-29ff6909-5ded-4a6d-b594-c7057b021e67 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.159656 May 19 16:46:57.077636 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 219/443] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:56 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:46:57.694505 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:57.695111 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:57.702122 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:57.702571 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:57.703337 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:57.703775 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:57.842929 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:57.851897 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9fa9494c-25fd-409b-8a0b-93be6a7091d1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.161151 May 19 16:46:57.852689 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 225/444] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:57 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:46:58.095974 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:58.096575 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:58.103324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:58.103817 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:58.104585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:58.105017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:58.235841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:58.240070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:58.246024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:58.247525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:58.248692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4a28994b-da33-48b1-a7fd-ebb9e6743c2f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.156703 May 19 16:46:58.249263 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 220/445] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:58 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:46:58.870088 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:58.870628 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:58.877527 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:58.877972 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:58.878733 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:58.879783 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:59.024680 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:59.032624 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2cc580a9-5007-400d-89d8-4267297378aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.166695 May 19 16:46:59.033229 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 226/446] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:46:58 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:46:59.268249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:46:59.269199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:46:59.271358 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:59.272065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=12 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:46:59.279916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:59.280471 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:59.281182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:46:59.281628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:46:59.416974 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:59.426712 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:59.428238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:46:59.429428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-013b49aa-ebbb-4034-b66a-827a434349ba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.165730 May 19 16:46:59.429987 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 221/447] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:46:59 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:00.050346 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:00.051013 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:00.057497 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:00.057954 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:00.058722 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:00.059160 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:00.076798 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:00.199275 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:00.206833 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-610383cf-449b-4a8a-baaa-967636c85700 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.160980 May 19 16:47:00.207409 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 227/448] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:47:00 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:47:00.448236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:00.448762 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:00.455553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:00.456005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:00.456778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:00.457760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:00.599738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:00.608263 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:00.609796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:00.610959 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ab189044-6cb4-499c-8f39-1555f672a58c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.166754 May 19 16:47:00.611525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 222/449] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:00 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:01.225926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:01.227086 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:01.234422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:01.235351 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:01.236545 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:01.237189 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:01.478287 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:01.489986 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5e913466-c324-4292-83e3-e5b05a187ac2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.268760 May 19 16:47:01.490789 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 228/450] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:47:01 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:47:01.629044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:01.629691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:01.636726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:01.637270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:01.638056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:01.638491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:01.772932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:01.781076 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:01.782613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:01.783777 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e1a9c23b-3f0e-49da-a165-039ee90ccba6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.158954 May 19 16:47:01.784334 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 223/451] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:01 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:02.508235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:02.508841 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:02.515587 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:02.516029 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:02.516794 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:02.517247 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:02.676058 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:02.690865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2621bbb1-b176-4f95-a212-383149ae151f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.187159 May 19 16:47:02.691451 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 229/452] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:47:02 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:47:02.804179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:02.805141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:02.812287 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:02.812732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:02.813541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:02.813975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:02.958270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:02.967724 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:02.969290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:02.970497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ae83ec73-4fbf-4266-b646-8851ea7ba906 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.172006 May 19 16:47:02.971450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 224/453] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:02 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:03.109183 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-fdb957ba-259c-4ab5-a7f7-5d2ae02cc42a req-94b1692c-9ea1-47da-89bc-d4c89a1f05dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b20a85-cbdd-4162-a605-e79b237afbb7", "name": "network-vif-plugged", "status": "completed", "tag": "7c85e1d9-2cb2-4a72-afa4-30d08738ec7f"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:47:03.118254 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-fdb957ba-259c-4ab5-a7f7-5d2ae02cc42a req-94b1692c-9ea1-47da-89bc-d4c89a1f05dc service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:03.118700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-fdb957ba-259c-4ab5-a7f7-5d2ae02cc42a req-94b1692c-9ea1-47da-89bc-d4c89a1f05dc service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:03.132999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-fdb957ba-259c-4ab5-a7f7-5d2ae02cc42a req-94b1692c-9ea1-47da-89bc-d4c89a1f05dc service nova] Creating event network-vif-plugged:7c85e1d9-2cb2-4a72-afa4-30d08738ec7f for instance 23b20a85-cbdd-4162-a605-e79b237afbb7 on hv-cinder-84243 May 19 16:47:03.138319 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-fdb957ba-259c-4ab5-a7f7-5d2ae02cc42a req-94b1692c-9ea1-47da-89bc-d4c89a1f05dc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033523 May 19 16:47:03.139129 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 230/454] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:47:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:47:03.709582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:03.710303 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:03.719495 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:03.720466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:03.720917 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:03.721273 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:03.868687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:03.876843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2825430a-1f65-4194-9b85-983c1a4e1cb6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.171894 May 19 16:47:03.877595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 225/455] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:47:03 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:47:03.991699 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:03.992539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:03.999766 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:03.999766 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:04.000350 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:04.000776 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:04.190425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:04.199648 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:04.201196 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:04.202382 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-027ddf99-70dd-47fb-87eb-86265cc6d430 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.216947 May 19 16:47:04.203112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 231/456] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:03 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:04.895269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:04.896020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:04.902755 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:04.903213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:04.903996 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:04.904437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:05.046323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:05.055459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-96708e42-4e4b-456f-b77e-701a44df87ed tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1366 microversion: 2.1 time: 0.164247 May 19 16:47:05.056808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 226/457] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:47:04 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:47:05.221813 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:05.222358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:05.230890 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:05.232101 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:05.232887 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:05.233358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:05.389221 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:05.398056 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:05.399658 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:05.400939 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-69679a79-f3ea-465b-b7b8-ca31f707aa8f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.184068 May 19 16:47:05.401966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 232/458] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:05 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:06.075831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:06.076434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:06.083352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:06.083798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:06.084555 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:06.085004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:06.216688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:06.224806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-951a3816-befa-4a19-bab9-86ee4552fee0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1555 microversion: 2.1 time: 0.152904 May 19 16:47:06.225420 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 227/459] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:47:06 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:47:06.240678 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3ec5507a-1b5f-41e6-8fd0-46ae10136b39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:06.241202 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3ec5507a-1b5f-41e6-8fd0-46ae10136b39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:06.247760 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ec5507a-1b5f-41e6-8fd0-46ae10136b39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:06.248209 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ec5507a-1b5f-41e6-8fd0-46ae10136b39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:06.248964 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ec5507a-1b5f-41e6-8fd0-46ae10136b39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:06.249433 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3ec5507a-1b5f-41e6-8fd0-46ae10136b39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:06.336736 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3ec5507a-1b5f-41e6-8fd0-46ae10136b39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099907 May 19 16:47:06.337363 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 233/460] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:47:06 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7/os-interface => generated 284 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:47:06.424023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:06.424576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:06.431378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:06.431832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:06.432641 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:06.433079 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:06.593988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:06.606266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:06.608267 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:06.610249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c05ec129-02ac-4977-b05a-f07d7332aacd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.190294 May 19 16:47:06.610930 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 228/461] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:06 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:07.351176 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-490d03f9-37e8-4fa2-bca8-da84afd30feb req-4142a1ae-6993-49e7-9efc-d42a6d639319 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "23b20a85-cbdd-4162-a605-e79b237afbb7", "tag": "7c85e1d9-2cb2-4a72-afa4-30d08738ec7f"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:47:07.359206 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-490d03f9-37e8-4fa2-bca8-da84afd30feb req-4142a1ae-6993-49e7-9efc-d42a6d639319 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:07.359702 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-490d03f9-37e8-4fa2-bca8-da84afd30feb req-4142a1ae-6993-49e7-9efc-d42a6d639319 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:07.370725 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-490d03f9-37e8-4fa2-bca8-da84afd30feb req-4142a1ae-6993-49e7-9efc-d42a6d639319 service nova] Creating event network-changed:7c85e1d9-2cb2-4a72-afa4-30d08738ec7f for instance 23b20a85-cbdd-4162-a605-e79b237afbb7 on hv-cinder-84243 May 19 16:47:07.375501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-490d03f9-37e8-4fa2-bca8-da84afd30feb req-4142a1ae-6993-49e7-9efc-d42a6d639319 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028441 May 19 16:47:07.376086 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 234/462] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:47:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:47:07.629963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:07.630583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:07.637030 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:07.637675 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:07.638459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:07.638900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:07.772484 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:07.780474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:07.782056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:07.783218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1535687f-5f8e-4bb2-8224-1c8fc807e838 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.158147 May 19 16:47:07.783772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 229/463] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:07 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:08.802830 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:08.803377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:08.809475 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:08.809921 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:08.810671 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:08.811100 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:08.943348 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:08.951886 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:08.953467 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:08.954633 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5757ce10-5019-460f-baf3-369ffb0e7aa1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.156943 May 19 16:47:08.955195 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 235/464] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:08 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:09.974573 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:09.975334 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:09.983264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:09.983762 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:09.984599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:09.985035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:10.118648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:10.126775 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:10.128307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:10.129480 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-271a4b1b-e2cc-4fec-af8d-31a55975e849 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.158844 May 19 16:47:10.130033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 230/465] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:09 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:11.148852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:11.149630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:11.156457 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:11.156899 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:11.157819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:11.158262 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:11.327103 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:11.335867 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:11.337414 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:11.338579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d9f2ecc6-5674-4270-9e6b-51f4d7cf8458 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.194649 May 19 16:47:11.339138 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 236/466] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:11 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:12.360320 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:12.360945 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:12.368205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:12.368659 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:12.369446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:12.369888 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:12.503313 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:12.511152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:12.512655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:12.513810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8fd275d8-e025-48f2-8362-a60ac4f3206e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1743 microversion: 2.20 time: 0.157443 May 19 16:47:12.514363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 231/467] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:12 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1743 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:13.531920 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:13.532552 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:13.539765 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:13.540216 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:13.540979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:13.541440 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:13.669492 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:13.677733 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:13.679227 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:13.680372 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3696a405-2708-431e-9f86-b5563e7527ce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1743 microversion: 2.20 time: 0.152359 May 19 16:47:13.680926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 237/468] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:13 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1743 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:47:14.698946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:14.699567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:14.706209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:14.706662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:14.707431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:14.707874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:15.056945 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:15.069136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:15.071013 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:15.072295 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d6b09d63-73c6-4180-b6ac-7a3e48121066 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1743 microversion: 2.20 time: 0.377313 May 19 16:47:15.073110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 232/469] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:14 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1743 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:15.219606 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-1d053357-4625-4f16-8c4d-0379adc0d4df req-d993d594-5445-4995-8300-4747cacd6d8d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6d6a59-35a3-46b0-a92a-a3ae729071b7", "name": "network-vif-plugged", "status": "completed", "tag": "5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:47:15.235248 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-1d053357-4625-4f16-8c4d-0379adc0d4df req-d993d594-5445-4995-8300-4747cacd6d8d service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:15.235248 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-1d053357-4625-4f16-8c4d-0379adc0d4df req-d993d594-5445-4995-8300-4747cacd6d8d service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:15.247163 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-1d053357-4625-4f16-8c4d-0379adc0d4df req-d993d594-5445-4995-8300-4747cacd6d8d service nova] Creating event network-vif-plugged:5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc for instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 on hv-cinder-84243 May 19 16:47:15.256257 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-1d053357-4625-4f16-8c4d-0379adc0d4df req-d993d594-5445-4995-8300-4747cacd6d8d service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042124 May 19 16:47:15.257871 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 238/470] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:47:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:47:16.093884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:16.094497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:16.096884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:16.103103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:16.103690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:16.104615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:16.105130 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:16.247966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:16.256990 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:16.258422 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:16.259591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-51c6f62c-5b32-4415-9046-eb2e7462f627 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1743 microversion: 2.20 time: 0.169791 May 19 16:47:16.260139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 233/471] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:16 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1743 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:17.278985 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:17.279596 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:17.281729 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=58 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:17.287667 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:17.288150 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:17.288926 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:17.289390 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:17.440399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:17.449244 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:17.451042 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:17.452388 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8e3072d8-7502-47e2-a5cb-e5c5139cfc54 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1743 microversion: 2.20 time: 0.178262 May 19 16:47:17.453214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 239/472] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:17 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1743 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:18.472153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:18.472763 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:18.479960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:18.480414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:18.481206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:18.481650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:18.628453 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:18.637589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:18.639291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:18.640626 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9f9bc53e-aa58-485a-a95b-c02217649a3e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1743 microversion: 2.20 time: 0.172494 May 19 16:47:18.641293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 234/473] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:18 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1743 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:19.663261 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:19.663901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:19.673170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:19.674481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:19.676084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:19.677090 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:19.823710 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:19.831815 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:19.833901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:19.835097 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f1db3acc-c150-430a-a92b-1c9a033c231f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1743 microversion: 2.20 time: 0.175849 May 19 16:47:19.835987 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 240/474] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:19 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1743 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:20.856397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:20.857023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:20.863937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:20.865016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:20.865941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:20.866194 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:21.067436 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:21.083771 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:21.085636 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:21.087064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fa0cfe8e-d984-4e41-a6b0-d7ea7fba5261 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.237506 May 19 16:47:21.088142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 235/475] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:20 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:22.144477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:22.144477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:22.144477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:22.144477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:22.145950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:22.145950 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:22.352345 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:22.363794 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:22.365780 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:22.367623 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-270836cb-b77c-4bf1-8aa0-3ea5bb49c0cb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.253202 May 19 16:47:22.370333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 241/476] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:22 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:23.391001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:23.391658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:23.402995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:23.403562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:23.404474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:23.404988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:23.558445 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:23.567116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:23.569197 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:23.570574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b56b90d4-e786-4fc7-baa5-0a6d57186eaf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.183415 May 19 16:47:23.581178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 236/477] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:23 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:24.589559 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:24.590451 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:24.597579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:24.598096 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:24.599355 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:24.599609 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:24.793176 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:24.802201 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:24.803969 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:24.805603 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2c346f4a-bec4-47bb-99eb-7e58e4948da5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.219817 May 19 16:47:24.816819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 242/478] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:24 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:25.825916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:25.826752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:25.834120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:25.834685 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:25.835553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:25.836107 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:25.857985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:26.005532 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:26.015174 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:26.016847 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:26.018074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cf4e4956-f2a3-47a3-af69-99e9e739d7ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.197898 May 19 16:47:26.029620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 237/479] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:25 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:27.038266 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:27.038866 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:27.045420 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:27.046015 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:27.046784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:27.047355 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:27.197360 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:27.205887 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:27.207609 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:27.209455 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-383ca0ce-c0c1-4781-8c35-ee48582764e7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.176563 May 19 16:47:27.219946 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 243/480] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:27 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:28.226836 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:28.227392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:28.234323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:28.234781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:28.235557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:28.235990 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:28.381613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:28.393509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:28.398631 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:28.400454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-37618346-5b27-4f2b-90c3-0c17d10fdcad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.177493 May 19 16:47:28.401372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 238/481] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:28 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:29.419673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:29.420978 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:29.428454 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:29.429190 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:29.429988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:29.430481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:29.591028 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:29.600140 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:29.602063 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:29.603273 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-db0a0061-8e19-41da-aaa3-2ac251194d52 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.187625 May 19 16:47:29.603990 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 244/482] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:29 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:30.621529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:30.622140 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:30.628870 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:30.629363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:30.630133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:30.630564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:30.758490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:30.766395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:30.767901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:30.769046 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d6027a21-6718-456b-a942-00f3351c6dce tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.151382 May 19 16:47:30.769632 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 239/483] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:30 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:31.788475 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:31.789078 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:31.795767 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:31.796217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:31.796986 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:31.797450 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:31.800053 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=92 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:31.930662 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:31.938707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:31.940210 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:31.941478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5e096b00-2393-4603-8fe8-a8327ee5b680 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.157522 May 19 16:47:31.942564 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 245/484] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:31 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:32.959908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:32.960519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:32.967333 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:32.967783 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:32.968542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:32.968981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:33.098730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:33.106699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:33.108084 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:33.109269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-99fc68b4-3fc8-4b97-913d-c3f01767b677 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.153294 May 19 16:47:33.109866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 240/485] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:32 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:34.132731 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:34.133391 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:34.139975 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:34.140420 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:34.141200 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:34.141636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:34.277326 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:34.285173 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:34.286683 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:34.287835 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4e4a2233-ad52-4643-bd13-b7467d5aa083 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.162450 May 19 16:47:34.288389 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 246/486] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:34 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:35.306198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:35.306739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:35.313212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:35.313662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:35.314415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:35.314844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:35.445258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:35.453173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:35.454700 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:35.455846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-93671b15-3d8e-4648-a432-ff3204028e0d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1738 microversion: 2.20 time: 0.153641 May 19 16:47:35.456402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 241/487] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:35 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:36.475044 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:36.476332 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:36.483149 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:36.483600 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:36.484609 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:36.484912 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:36.697805 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:36.705814 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:36.707827 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:36.708979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-fa265012-b424-4075-b213-bb41a5d198bf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1720 microversion: 2.20 time: 0.238857 May 19 16:47:36.709570 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 247/488] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:36 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1720 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:37.727633 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:37.728241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:37.734731 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:37.735180 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:37.735934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:37.736366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:37.866167 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:37.874064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:37.875584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:37.877002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bbf674c6-742d-4574-a5e2-830a2f69a694 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1720 microversion: 2.20 time: 0.153277 May 19 16:47:37.877587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 242/489] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:37 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:38.895078 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:38.895684 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:38.902142 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:38.902587 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:38.903335 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:38.903763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:39.033015 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:39.040918 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:39.042456 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:39.043619 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a5c7dc5f-11b4-4100-bd34-dbab55a32cef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1720 microversion: 2.20 time: 0.152549 May 19 16:47:39.044172 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 248/490] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:38 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:40.062015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:40.062620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:40.069716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:40.070169 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:40.070937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:40.071368 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:40.201841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:40.210377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:40.211884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:40.213042 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-04126f26-d7eb-4953-b8b1-dfb9eecddbbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1720 microversion: 2.20 time: 0.154922 May 19 16:47:40.213635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 243/491] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:40 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1720 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:41.097105 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-6cb81618-8257-4bcd-bdbf-aab4144a0d32 req-71e7d0ba-bde2-4d89-9845-0f59ccf61dc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6d6a59-35a3-46b0-a92a-a3ae729071b7", "name": "network-vif-unplugged", "status": "completed", "tag": "5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:47:41.106757 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-6cb81618-8257-4bcd-bdbf-aab4144a0d32 req-71e7d0ba-bde2-4d89-9845-0f59ccf61dc8 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:41.107238 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-6cb81618-8257-4bcd-bdbf-aab4144a0d32 req-71e7d0ba-bde2-4d89-9845-0f59ccf61dc8 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:41.118220 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-6cb81618-8257-4bcd-bdbf-aab4144a0d32 req-71e7d0ba-bde2-4d89-9845-0f59ccf61dc8 service nova] Creating event network-vif-unplugged:5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc for instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 on hv-cinder-84243 May 19 16:47:41.123164 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-6cb81618-8257-4bcd-bdbf-aab4144a0d32 req-71e7d0ba-bde2-4d89-9845-0f59ccf61dc8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.029772 May 19 16:47:41.123739 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 249/492] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:47:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:47:41.231174 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:41.231783 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:41.238192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:41.238761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:41.239424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:41.239944 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:41.369709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:41.377929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:41.380083 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:41.381275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7a0d6354-c34e-4451-bdc8-5443f13863a1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1720 microversion: 2.20 time: 0.153986 May 19 16:47:41.381834 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 244/493] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:41 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1720 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:42.400373 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:42.401069 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:42.407516 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:42.407959 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:42.408711 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:42.409137 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:42.543788 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:42.551843 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:42.553374 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:42.554530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4181e86b-a7f5-40fc-991d-e88fc960f466 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1720 microversion: 2.20 time: 0.158851 May 19 16:47:42.555085 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 250/494] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:42 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:43.574789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:43.575310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:43.581339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:43.581821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:43.582582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:43.583037 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:43.716498 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:43.724893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:43.726432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:43.727583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-75087809-2532-4e63-9583-62b0f0095bbf tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1663 microversion: 2.20 time: 0.158852 May 19 16:47:43.728141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 245/495] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:43 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1663 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:43.745607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e4b4a3c9-3f93-4c1e-a37b-ca42deda3b07 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6a776be6-be5d-4157-b926-1da7ef38fcd1"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:47:43.746720 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e4b4a3c9-3f93-4c1e-a37b-ca42deda3b07 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:43.754061 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4b4a3c9-3f93-4c1e-a37b-ca42deda3b07 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:43.754531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4b4a3c9-3f93-4c1e-a37b-ca42deda3b07 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:43.755473 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4b4a3c9-3f93-4c1e-a37b-ca42deda3b07 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:43.755941 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4b4a3c9-3f93-4c1e-a37b-ca42deda3b07 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:44.034542 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e4b4a3c9-3f93-4c1e-a37b-ca42deda3b07 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.292943 May 19 16:47:44.035142 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 251/496] 10.222.0.36 () {62 vars in 1363 bytes} [Thu May 19 16:47:43 2022] POST /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments => generated 188 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:47:44.147868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e2599dd1-e118-412c-9261-0971e562d609 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:47:44.148433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e2599dd1-e118-412c-9261-0971e562d609 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:44.154490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2599dd1-e118-412c-9261-0971e562d609 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:44.154945 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2599dd1-e118-412c-9261-0971e562d609 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:44.155704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2599dd1-e118-412c-9261-0971e562d609 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:44.156144 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e2599dd1-e118-412c-9261-0971e562d609 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:44.245014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e2599dd1-e118-412c-9261-0971e562d609 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/action" status: 202 len: 0 microversion: 2.20 time: 0.101016 May 19 16:47:44.245655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 246/497] 10.222.0.36 () {62 vars in 1318 bytes} [Thu May 19 16:47:44 2022] POST /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 16:47:44.255626 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:44.256525 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:44.264402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:44.264402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:44.265425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:44.265930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:44.411486 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:44.420017 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:44.421712 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:44.422989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b85717c1-6652-4afa-896e-def56484159a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1749 microversion: 2.20 time: 0.173022 May 19 16:47:44.423621 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 252/498] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:44 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1749 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:45.443578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:45.444763 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:45.450856 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:45.451310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:45.452080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:45.452523 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:45.589049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:45.597642 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:45.599238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:45.600396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ef92ecd5-8ef5-4e27-a2b3-2bc0d705ef60 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1751 microversion: 2.20 time: 0.162145 May 19 16:47:45.600951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 247/499] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:45 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1751 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:46.618892 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:46.619502 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:46.626320 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:46.626768 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:46.627528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:46.627963 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:46.842388 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:46.851293 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:46.852785 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:46.854112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-88d1ff9a-e71e-4335-8ca5-9f3a9d7d5548 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.238970 May 19 16:47:46.854748 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 253/500] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:46 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:47.873133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:47.873770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:47.876370 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=32 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:47.892292 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:47.894093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:47.896622 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:47.900596 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:48.126240 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:48.138229 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:48.139824 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:48.140992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ab3c18b4-4aef-4e92-b20d-fca6b7e35a13 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.271780 May 19 16:47:48.153129 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 248/501] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:47 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:49.161862 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:49.162726 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:49.165203 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=30 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:49.171066 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:49.171673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:49.172526 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:49.173228 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:49.594260 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:49.604575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:49.606131 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:49.607334 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7467facc-214c-4142-aa81-c40845c7d115 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.450015 May 19 16:47:49.607879 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 254/502] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:49 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:50.628184 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:50.628817 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:50.640048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:50.640589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:50.641427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:50.641876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:50.936625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:50.956752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:50.958653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:50.960044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9a019144-a8fa-4855-8fd0-0d66c488cd66 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.336637 May 19 16:47:50.960756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 249/503] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:50 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:51.991448 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:51.992543 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:52.008457 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:52.008901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:52.009707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:52.010141 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:52.270536 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:52.288543 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:52.291167 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:52.298457 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ac7623e8-36ae-4e5e-b145-3b892d2d3f45 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.317680 May 19 16:47:52.299816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 255/504] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:51 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:53.318387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:53.319868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:53.327059 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:53.327969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:53.329128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:53.329868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:53.592172 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:53.615170 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:53.616772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:53.618033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c1080296-868f-4f5d-a8ce-711e1bff38ea tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.304048 May 19 16:47:53.625796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 250/505] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:53 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:54.636358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:54.637017 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:54.655250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:54.657664 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:54.658501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:54.661436 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:54.878218 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:54.893859 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:54.896528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:54.898146 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0af34580-2e66-47fe-86a0-3fbf940ef21d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.265595 May 19 16:47:54.898707 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 256/506] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:54 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:55.918145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:55.918776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:55.927505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:55.928139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:55.929299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:55.930192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:55.955887 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:47:56.149599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:56.165431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:56.168708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:56.170446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1e373854-2bc8-4996-9822-228a625de35a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.257093 May 19 16:47:56.171353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 251/507] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:55 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:57.190271 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:57.192495 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:57.204427 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:57.205192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:57.205970 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:57.209258 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:57.555962 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:57.569290 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:57.571576 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:57.583508 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-dcd5beaf-07d3-4599-928b-a51946cacbac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.389052 May 19 16:47:57.584452 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 257/508] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:57 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:47:58.604915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:47:58.605682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:47:58.622500 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:58.623065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:58.624103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:47:58.626631 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:47:59.069419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:59.089423 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:59.098237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:47:59.108198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-61a00515-6b6a-4302-a8ad-bf753fde6950 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.506486 May 19 16:47:59.110364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 252/509] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:47:58 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:00.128368 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:00.129701 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:00.143243 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:00.143872 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:00.145431 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:00.149905 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:00.898769 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:00.909445 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:00.913030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:00.920988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f71f1252-53f1-498f-8243-ab50dba9c337 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.797236 May 19 16:48:00.921931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 258/510] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:00 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 799 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:01.940057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:01.940648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:01.947849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:01.948529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:01.949499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:01.950119 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:02.221912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:02.232893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:02.236404 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:02.238861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c11d7207-aee2-4425-ba9c-23dd9f6bc222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.302117 May 19 16:48:02.251219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 253/511] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:01 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:03.258484 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:03.260414 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:03.267523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:03.268263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:03.270425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:03.271110 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:03.295930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=89,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:03.443524 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:03.454561 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:03.456586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:03.458699 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e27aabd3-95cb-4db0-93ef-ca3f4eeda36b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.205000 May 19 16:48:03.459583 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 259/512] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:03 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:04.481020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:04.482548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:04.491608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:04.492065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:04.492857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:04.493337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:04.774967 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:04.791932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:04.795291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:04.797663 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3bd0ff7d-a9d9-4a53-bb1b-0d26a5b4a4e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.321259 May 19 16:48:04.799025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 254/513] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:04 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:05.821736 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:05.823464 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:05.835880 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:05.836805 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:05.837995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:05.838679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:05.928478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ed5444ab-7996-471e-acc2-b293cdb31fc9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:05.929074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ed5444ab-7996-471e-acc2-b293cdb31fc9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:05.939841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed5444ab-7996-471e-acc2-b293cdb31fc9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:05.947095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed5444ab-7996-471e-acc2-b293cdb31fc9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:05.948167 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed5444ab-7996-471e-acc2-b293cdb31fc9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:05.948757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed5444ab-7996-471e-acc2-b293cdb31fc9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:05.990941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ed5444ab-7996-471e-acc2-b293cdb31fc9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/ips" status: 200 len: 145 microversion: 2.1 time: 0.066735 May 19 16:48:05.996640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 255/514] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:48:05 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/ips => generated 145 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:48:06.035875 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:06.048108 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:06.050019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:06.051720 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a45c9fe9-7fc6-4a6f-a2bf-64f58e0f9795 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.233879 May 19 16:48:06.052280 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 260/515] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:05 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:07.070724 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:07.071366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:07.073661 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 16:48:07.074410 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Thu May 19 16:48:07 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 16:48:07.081225 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:07.081952 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:07.083235 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:07.084000 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:07.443499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:07.456764 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:07.456764 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:07.457178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-61b34064-30d4-482e-8944-71d8e7a85002 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.391053 May 19 16:48:07.458231 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 256/516] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:07 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:08.475567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:08.476287 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:08.483286 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:08.484019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:08.484881 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:08.485432 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:08.562526 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a6a4648-0748-4eca-9a78-ba2c43389bbc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f19507a1-b6bd-4346-820a-e9be2eab25cc"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:08.563674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9a6a4648-0748-4eca-9a78-ba2c43389bbc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:08.572445 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a6a4648-0748-4eca-9a78-ba2c43389bbc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:08.572891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a6a4648-0748-4eca-9a78-ba2c43389bbc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:08.576378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a6a4648-0748-4eca-9a78-ba2c43389bbc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:08.577574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a6a4648-0748-4eca-9a78-ba2c43389bbc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:08.648357 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:08.657471 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:08.659290 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:08.661627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a8c6691d-1430-4089-8059-96b0e251ffbb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.189725 May 19 16:48:08.683887 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 261/517] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:08 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:08.896908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9a6a4648-0748-4eca-9a78-ba2c43389bbc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.339126 May 19 16:48:08.898665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 257/518] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:48:08 2022] POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-volume_attachments => generated 194 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:48:09.689974 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:09.690512 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:09.698550 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:09.699370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:09.700311 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:09.700740 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:09.852205 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:09.864553 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:09.866513 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:09.867662 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9fcc6e69-95f6-4e11-8060-7dac2b139d02 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.181774 May 19 16:48:09.868212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 262/519] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:09 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:10.891776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:10.891776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:10.895719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:10.896210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:10.896948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:10.897403 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:11.006413 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-932d2bbb-0e42-45f1-84c7-4af8f552c9c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Action: 'create', calling method: .version_select at 0x7f4893564280>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1575118185", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCBvh0MVLtLsgg56SmNMlUHvaQlcf54UwQ8KA7U+vewJnshHvKOGxFPLESFC/o3VsAVPZu2ZgnmxWeiR/DBrFZRvI7TzCr+rjxuPy2FEghEiTXzPckWjs8UxqsF/freSwQ=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:11.022352 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-932d2bbb-0e42-45f1-84c7-4af8f552c9c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Getting quotas for project 66c1f23fbe114e9885266a0092cca13c. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:48:11.026422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-932d2bbb-0e42-45f1-84c7-4af8f552c9c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Getting quotas for user 39a11fe9bc8549639e7e13b6f490641c and project 66c1f23fbe114e9885266a0092cca13c. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:48:11.041837 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:11.049292 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-932d2bbb-0e42-45f1-84c7-4af8f552c9c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047427 May 19 16:48:11.049904 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 263/520] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:48:11 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:11.051271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:11.052882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:11.054157 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ce09b8bd-a6e3-4016-a35f-013a28c0bf4a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.172497 May 19 16:48:11.054775 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 258/521] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:10 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:11.098504 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-695005440", "imageRef": "bd258e5b-3a09-43ed-b224-f1601b9f04a1", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1575118185", "networks": [{"uuid": "456c9702-9a69-4541-891a-938fd3d1a085"}]}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:11.150073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.network.neutron [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] validate_networks() for [('456c9702-9a69-4541-891a-938fd3d1a085', None, None, None, None, None)] {{(pid=124123) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:48:11.560466 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Flavor limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:48:11.560910 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Image limits 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:48:11.561420 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Flavor pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:48:11.561859 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Image pref 0:0:0 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:48:11.562256 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.virt.hardware [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124123) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:48:11.572047 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:11.572498 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:11.573323 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:11.573761 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:11.590210 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Getting quotas for project 66c1f23fbe114e9885266a0092cca13c. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:48:11.594166 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Getting quotas for user 39a11fe9bc8549639e7e13b6f490641c and project 66c1f23fbe114e9885266a0092cca13c. Resources: {'cores', 'ram', 'instances'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:48:11.605728 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Going to run 1 instances... {{(pid=124123) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:48:11.607940 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='bd258e5b-3a09-43ed-b224-f1601b9f04a1',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124123) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:48:11.654388 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-aebd28f2-4972-428d-b68b-8f0efa9d8942 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.560714 May 19 16:48:11.655225 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 264/522] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:48:11 2022] POST /compute/v2.1/servers => generated 380 bytes in 562 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:48:11.665269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ed208824-d83a-434d-9d1b-56afbb171909 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:11.665878 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ed208824-d83a-434d-9d1b-56afbb171909 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:11.719293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ed208824-d83a-434d-9d1b-56afbb171909 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:11.726492 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ed208824-d83a-434d-9d1b-56afbb171909 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1258 microversion: 2.1 time: 0.065125 May 19 16:48:11.727056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 259/523] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:11 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:12.072793 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:12.073436 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:12.080432 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:12.080876 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:12.082237 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:12.082670 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:12.227415 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:12.236310 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:12.238020 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:12.239257 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8183eb90-53b6-4896-8393-1f0825de814b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.170464 May 19 16:48:12.239819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 265/524] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:12 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:12.743655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:12.744375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:12.751620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:12.752320 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:12.753351 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:12.754508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:12.822963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:12.832671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c09ed951-0c8a-4a0a-a706-907ca8551d85 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1318 microversion: 2.1 time: 0.092855 May 19 16:48:12.842350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 260/525] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:12 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1318 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:13.258523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:13.259717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:13.278092 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:13.278717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:13.279637 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:13.280204 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:13.566998 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:13.578579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:13.580459 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:13.582741 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e7231019-975f-4fab-8685-938286362743 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.328923 May 19 16:48:13.583481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 266/526] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:13 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:13.850589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:13.851388 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:13.858308 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:13.858761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:13.859540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:13.859977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:14.018658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:14.028675 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b9d33793-f755-442a-af12-1d5f6ed21f3e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.182503 May 19 16:48:14.042021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 261/527] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:13 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:14.602103 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:14.603521 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:14.610443 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:14.610886 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:14.611874 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:14.612304 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:14.766358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:14.775126 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:14.776778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:14.777970 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-25116e1f-a711-4a70-91e6-86fc4cc39c65 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.179921 May 19 16:48:14.778516 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 267/528] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:14 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:15.047380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:15.048135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:15.055508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:15.056045 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:15.056912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:15.057452 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:15.194360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:15.202070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1711a067-bf85-406a-90a0-af8bdaad6d55 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.158649 May 19 16:48:15.202822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 262/529] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:15 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:15.355917 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-10e0b5b2-7f7e-4fd5-beda-1e939808855f req-dbf84c87-a3d6-4d7d-8a99-d729842f900c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6d6a59-35a3-46b0-a92a-a3ae729071b7", "name": "network-vif-plugged", "status": "completed", "tag": "5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:15.365016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-10e0b5b2-7f7e-4fd5-beda-1e939808855f req-dbf84c87-a3d6-4d7d-8a99-d729842f900c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:15.365665 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-10e0b5b2-7f7e-4fd5-beda-1e939808855f req-dbf84c87-a3d6-4d7d-8a99-d729842f900c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:15.377780 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-10e0b5b2-7f7e-4fd5-beda-1e939808855f req-dbf84c87-a3d6-4d7d-8a99-d729842f900c service nova] Creating event network-vif-plugged:5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc for instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 on hv-cinder-84243 May 19 16:48:15.383225 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-10e0b5b2-7f7e-4fd5-beda-1e939808855f req-dbf84c87-a3d6-4d7d-8a99-d729842f900c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031165 May 19 16:48:15.384067 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 268/530] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:48:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:15.797509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:15.798035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:15.804215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:15.804671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:15.805475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:15.805940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:15.940537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:15.949354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:15.950878 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:15.952057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-53ee5a8f-dc95-4c39-a05b-6e48b4efca8c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.158870 May 19 16:48:15.952651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 263/531] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:15 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:16.219725 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:16.221132 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:16.228245 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:16.228700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:16.229573 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:16.230012 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:16.373223 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:16.381292 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a60c4dfa-e9ca-43f3-851d-414a1ca10f76 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.166519 May 19 16:48:16.381859 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 269/532] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:16 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:17.084658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:17.085317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:17.091504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:17.091966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:17.092749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:17.093209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:17.230028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:17.238759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:17.240557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:17.241767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4acecb77-9077-4099-a86b-87be5cc6b9e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.275912 May 19 16:48:17.242357 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 264/533] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:16 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:17.399227 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:17.400199 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:17.408812 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:17.409297 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:17.410114 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:17.410613 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:17.560080 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:17.569053 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5d1f2b1b-5546-4eef-befd-c46c7bf7f235 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.173946 May 19 16:48:17.569667 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 270/534] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:17 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:18.260139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:18.260707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:18.263134 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=36 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:18.268871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:18.269358 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:18.270135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:18.270571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:18.420765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:18.429278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:18.430784 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:18.431976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5c83c0af-1442-4749-a385-d34ef01095dc tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.175799 May 19 16:48:18.432531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 265/535] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:18 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:18.585817 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:18.586434 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:18.592990 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:18.593482 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:18.594248 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:18.594681 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:18.732418 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:18.740873 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c114d1a6-239a-4913-8aab-14216b047bd2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.158943 May 19 16:48:18.741528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 271/536] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:18 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:19.449980 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:19.450926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:19.457415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:19.458379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:19.459153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:19.459777 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:19.594683 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:19.604009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:19.605290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:19.606443 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0215e3de-51c5-4ef3-920a-4ff10da4b043 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.160386 May 19 16:48:19.606992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 266/537] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:19 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:19.763907 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:19.764476 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:19.766930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=58,nova_api:INSERT=4 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:19.772989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:19.773463 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:19.774238 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:19.774673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:19.915508 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:19.923411 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6e8bb069-a539-4067-875c-7361965b3627 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.163313 May 19 16:48:19.923988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 272/538] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:19 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:20.623801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:20.624450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:20.631778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:20.632225 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:20.633003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:20.633466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:20.816392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:20.818748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:20.827374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:20.828884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:20.830091 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b34d8b6b-873d-45dd-891f-ae428ca691ab tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.210177 May 19 16:48:20.830643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 267/539] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:20 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:20.939860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:20.940546 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:20.947453 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:20.947996 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:20.948865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:20.949362 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:21.092988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:21.102606 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-10daad1c-e489-4ff6-a153-dcfed00017d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.166215 May 19 16:48:21.103648 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 273/540] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:20 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:21.848417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:21.850456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:21.854907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:21.863570 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:21.864024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:21.865459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:21.865905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:22.006394 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:22.015117 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:22.016778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:22.017984 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e60f6c72-3605-4f57-8b4c-45a5026aed1c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.173446 May 19 16:48:22.018544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 268/541] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:21 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:22.122860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:22.123479 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:22.129641 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:22.130732 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=10 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:22.134136 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:22.134651 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:22.135427 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:22.135863 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:22.280204 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:22.288518 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-530e5c87-0f74-46d9-a1e1-bec9ece576e4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.170268 May 19 16:48:22.289315 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 274/542] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:22 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:23.035999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:23.036621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:23.043175 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:23.043620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:23.044377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:23.044809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:23.180608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:23.189771 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:23.191392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:23.192830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4fa2e4ea-ba1a-4ff3-8dde-4ebd60bc538d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.160578 May 19 16:48:23.193838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 269/543] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:23 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:23.305782 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:23.306505 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:23.313380 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:23.313829 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:23.314599 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:23.315033 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:23.456122 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:23.464098 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c71a4a67-fa50-4fd2-92cc-3eb38dae6ce4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.162791 May 19 16:48:23.464675 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 275/544] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:23 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:24.211612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:24.212354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:24.219001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:24.219450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:24.220210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:24.220643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:24.362099 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:24.371799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:24.373363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:24.374523 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e5381fc2-4b39-4fa4-8f4b-17efab52cfa5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.167384 May 19 16:48:24.375352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 270/545] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:24 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:24.484420 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:24.485033 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:24.492386 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:24.492831 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:24.493623 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:24.494056 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:24.629995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:24.637676 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f317f983-7864-463e-a242-5a6e3fb51b17 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.159373 May 19 16:48:24.638242 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 276/546] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:24 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:24.987496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c53b1cf2-5f0d-49c6-96b0-909efd01a46f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bf404241-ba86-419f-8f0a-962f86c3d36e"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:24.988703 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c53b1cf2-5f0d-49c6-96b0-909efd01a46f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:24.995405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c53b1cf2-5f0d-49c6-96b0-909efd01a46f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:24.995853 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c53b1cf2-5f0d-49c6-96b0-909efd01a46f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:24.996612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c53b1cf2-5f0d-49c6-96b0-909efd01a46f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:24.997043 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c53b1cf2-5f0d-49c6-96b0-909efd01a46f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:25.393313 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:25.393925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:25.400460 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:25.400912 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:25.401702 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:25.402138 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:25.534397 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:25.543494 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:25.545006 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:25.546221 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1f459d6c-db83-48aa-876a-affa538dfae5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.156895 May 19 16:48:25.546776 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 277/547] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:25 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:48:25.655142 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:25.655692 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:25.662311 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:25.662815 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:25.663567 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:25.663997 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:25.666539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:25.805842 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:25.813531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4dfeaf92-7490-4113-9d30-c30d6664210b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.162385 May 19 16:48:25.814089 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 278/548] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:25 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:26.563795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:26.564493 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:26.571704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:26.572149 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:26.572904 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:26.573359 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:26.705177 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:26.714135 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:26.715631 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:26.716776 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-45bf3470-eee7-4a0c-b82c-f6be715c624b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.156902 May 19 16:48:26.717358 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 279/549] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:26 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:48:26.830540 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:26.831171 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:26.838232 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:26.838674 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:26.839415 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:26.839841 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:26.968854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:26.976342 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3f45d2a2-0ad9-4a97-8cc8-c3c54453b30e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.149696 May 19 16:48:26.976901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 280/550] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:26 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:27.735201 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:27.735867 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:27.742344 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:27.742793 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:27.743539 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:27.743972 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:27.919797 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:27.929433 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:27.931076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:27.932309 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-98fb4f2e-4ac9-45df-b1cd-423aac9650ed tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.201050 May 19 16:48:27.932944 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 281/551] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:27 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:48:27.993440 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:27.994084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:28.000230 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:28.000721 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:28.001446 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:28.001876 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:28.242028 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:28.249782 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c198b655-5922-4a0c-912b-b04113990304 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.260543 May 19 16:48:28.250262 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 282/552] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:27 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:28.625999 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-c0fb135c-c8e7-488d-9a9c-51f56cb393d8 req-0f4cf2f6-ac81-4a1f-b69c-240bc9cc3780 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c98418-8020-43de-bbc8-d576ea6ef758", "tag": "c605e454-163b-4c14-a9ba-3e1b4b3ddc8a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:28.635676 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c0fb135c-c8e7-488d-9a9c-51f56cb393d8 req-0f4cf2f6-ac81-4a1f-b69c-240bc9cc3780 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:28.636112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c0fb135c-c8e7-488d-9a9c-51f56cb393d8 req-0f4cf2f6-ac81-4a1f-b69c-240bc9cc3780 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:28.651931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-c0fb135c-c8e7-488d-9a9c-51f56cb393d8 req-0f4cf2f6-ac81-4a1f-b69c-240bc9cc3780 service nova] Creating event network-changed:c605e454-163b-4c14-a9ba-3e1b4b3ddc8a for instance c0c98418-8020-43de-bbc8-d576ea6ef758 on hv-cinder-84243 May 19 16:48:28.657726 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-c0fb135c-c8e7-488d-9a9c-51f56cb393d8 req-0f4cf2f6-ac81-4a1f-b69c-240bc9cc3780 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035504 May 19 16:48:28.658326 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 283/553] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:48:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:48:28.882451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c53b1cf2-5f0d-49c6-96b0-909efd01a46f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.997539 May 19 16:48:28.883395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 271/554] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:48:24 2022] POST /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments => generated 194 bytes in 3999 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:28.950729 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:28.951428 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:28.958676 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:28.959125 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:28.959877 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:28.960313 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:29.141305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:29.150348 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:29.151865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:29.153022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-62388d33-03f8-44fc-8fc0-a25d07888b30 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.206531 May 19 16:48:29.153596 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 284/555] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:28 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:29.267653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:29.268344 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:29.275039 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:29.275501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:29.276239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:29.276670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:29.430049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:29.438577 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fd1d06b3-4810-4344-8fb2-703bfa316cd0 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.175514 May 19 16:48:29.439580 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 272/556] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:29 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:30.172086 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:30.172690 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:30.179935 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:30.180378 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:30.181273 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:30.181711 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:30.318632 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:30.320521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9603f571-6e2c-4c85-bdab-0812b71479d5 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:30.327261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9603f571-6e2c-4c85-bdab-0812b71479d5 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:30.327628 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:30.327867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9603f571-6e2c-4c85-bdab-0812b71479d5 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:30.329131 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:30.330302 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-46a2c58f-8c39-4034-8ddc-125ce8105276 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.162100 May 19 16:48:30.330855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 285/557] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:30 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:30.393624 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9603f571-6e2c-4c85-bdab-0812b71479d5 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Going to try to stop instance {{(pid=124122) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 16:48:30.435521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9603f571-6e2c-4c85-bdab-0812b71479d5 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action" status: 202 len: 0 microversion: 2.1 time: 0.119164 May 19 16:48:30.436054 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 273/558] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:48:30 2022] POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action => generated 0 bytes in 121 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:48:30.444638 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:30.445421 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:30.451462 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:30.451919 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:30.452678 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:30.453119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:30.455979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:30.456705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:30.462890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:30.463343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:30.464106 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:30.464544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:30.587104 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:30.595215 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-652b70b3-9915-4964-9e78-4e11ab8dcc1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.155002 May 19 16:48:30.595858 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 286/559] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:30 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:30.600007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:30.607438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-45c63821-60d5-4f63-952e-ce23312698a3 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.155541 May 19 16:48:30.607992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 274/560] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:30 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:31.348521 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:31.349131 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:31.356232 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:31.356597 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:31.357402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:31.357836 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:31.503818 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:31.513747 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:31.515288 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:31.516463 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-22ffb0d3-bdb5-4cbd-9f22-dcdfa675a4a9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.172489 May 19 16:48:31.517175 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 287/561] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:31 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:31.611953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:31.612567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:31.619891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:31.620348 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:31.621126 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:31.621588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:31.624382 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:31.625314 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:31.631841 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:31.632291 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:31.633347 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:31.633499 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:31.760780 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:31.768752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a41cc11a-a1f6-476c-a0ca-1ed8fcabe756 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.160729 May 19 16:48:31.769356 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 275/562] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:31 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:31.778532 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:31.786316 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-00c938f6-6c47-403e-be00-04754369143b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.165834 May 19 16:48:31.786885 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 288/563] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:31 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:32.534727 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:32.535338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:32.541752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:32.542205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:32.542995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:32.543432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:32.676927 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:32.685398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:32.686900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:32.688066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2821be2b-32f9-408c-b030-678678831a78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.157364 May 19 16:48:32.688623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 276/564] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:32 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:32.787407 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:32.787942 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:32.794780 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:32.795225 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:32.795979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:32.796403 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:32.804100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:32.804875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:32.810912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:32.811368 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:32.812140 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:32.812576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:32.932976 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:32.940866 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-87916ef5-eab3-40fb-9e50-4514721fa088 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.157933 May 19 16:48:32.941467 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 289/565] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:32 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:32.943536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:32.950975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-db624aa2-77b3-45a4-a1ec-e42e50adee78 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.151204 May 19 16:48:32.951530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 277/566] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:32 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:33.706710 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:33.707319 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:33.713945 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:33.714396 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:33.715175 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:33.715592 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:33.852795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:33.861196 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:33.862703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:33.864509 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1aaaca0e-5a01-458d-ac67-0d3889947eda tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1807 microversion: 2.20 time: 0.161069 May 19 16:48:33.865068 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 290/567] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:33 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:33.958838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:33.959397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:33.966027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:33.966475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:33.967241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:33.967682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:33.967805 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:33.968321 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:33.974811 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:33.975274 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:33.976032 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:33.976460 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:34.097129 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:34.103973 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:34.105948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b900e542-5eab-4332-8932-3c819fba9197 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.151054 May 19 16:48:34.106741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 278/568] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:33 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:34.111575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b9d8a41b-45d6-4df9-bcb4-2f3352e944cb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.147604 May 19 16:48:34.112143 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 291/569] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:33 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:34.882317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:34.882928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:34.889251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:34.889802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:34.890681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:34.891125 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:35.024428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:35.032861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:35.034408 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:35.036254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b233f4d2-26a9-4b53-9fd6-0077fee59491 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1794 microversion: 2.20 time: 0.157686 May 19 16:48:35.036826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 279/570] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:48:34 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:48:35.124136 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:35.125051 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:35.128024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:35.128643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:35.131755 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:35.132211 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:35.133036 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:35.133447 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:35.134699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:35.135162 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:35.135930 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:35.136372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:35.264639 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:35.267455 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:35.272822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e7be125d-427f-4463-83dc-5fdfc15a1f5c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.148749 May 19 16:48:35.275114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 280/571] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:35 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:35.278670 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9329334b-3b56-4669-a38b-f87d9a4d3d3b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.158619 May 19 16:48:35.279236 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 292/572] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:35 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:36.291412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:36.291996 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:36.299041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.299502 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.300280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.300718 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.303339 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:36.304150 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:36.310444 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.310899 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.311670 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.312098 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.445049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:36.450310 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:36.452553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f1b2ea8a-2b58-487f-8585-991543a677bf tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.165643 May 19 16:48:36.453298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 281/573] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:36 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:36.458035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:36.458377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c02d01a0-471b-433c-8e0f-5a97afc8496a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.159364 May 19 16:48:36.459832 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 293/574] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:36 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:36.460597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:36.466881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.467331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.468096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.468533 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.471148 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:36.498855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lazy-loading 'flavor' on Instance uuid deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:48:36.628505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0149ac1f-60b4-4a30-96fb-272602ea1b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/action" status: 200 len: 32 microversion: 2.1 time: 0.173923 May 19 16:48:36.629018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 282/575] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:48:36 2022] POST /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/action => generated 32 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 16:48:36.638171 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:36.638786 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:36.644854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.645613 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.646555 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:36.647001 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:36.875610 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:36.883751 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cc6f19dc-867d-47e9-ad47-d3c8e54cd054 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.249412 May 19 16:48:36.884480 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 294/576] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:36 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:37.446626 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-d445afc0-2087-4c7f-ae86-8f0ab086bbf9 req-95a84783-d603-4d02-93be-269a57412d78 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c98418-8020-43de-bbc8-d576ea6ef758", "name": "network-vif-plugged", "status": "completed", "tag": "c605e454-163b-4c14-a9ba-3e1b4b3ddc8a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:37.455716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d445afc0-2087-4c7f-ae86-8f0ab086bbf9 req-95a84783-d603-4d02-93be-269a57412d78 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:37.456210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-d445afc0-2087-4c7f-ae86-8f0ab086bbf9 req-95a84783-d603-4d02-93be-269a57412d78 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:37.471613 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:37.472388 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:37.472489 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-d445afc0-2087-4c7f-ae86-8f0ab086bbf9 req-95a84783-d603-4d02-93be-269a57412d78 service nova] Creating event network-vif-plugged:c605e454-163b-4c14-a9ba-3e1b4b3ddc8a for instance c0c98418-8020-43de-bbc8-d576ea6ef758 on hv-cinder-84243 May 19 16:48:37.478268 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-d445afc0-2087-4c7f-ae86-8f0ab086bbf9 req-95a84783-d603-4d02-93be-269a57412d78 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036090 May 19 16:48:37.479209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 283/577] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:48:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:37.481371 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:37.482201 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:37.482605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:37.483044 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:37.484036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:37.484657 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:37.492753 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:37.493556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:37.494561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:37.495191 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:37.500219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:37.646859 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:37.650728 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:37.656354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0740e6cd-2a5f-45c6-a889-51ecd34d887b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.176022 May 19 16:48:37.657053 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 284/578] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:37 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:37.662726 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f254015e-d040-48f1-8cd8-1549f515e9ed tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.194624 May 19 16:48:37.663561 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 295/579] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:37 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:37.901675 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:37.902287 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:37.908281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:37.908735 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:37.909534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:37.909968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:38.041117 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:38.049015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-245012d0-a311-4cce-9869-95a8b07cb20d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.151201 May 19 16:48:38.049602 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 285/580] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:37 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:38.674202 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:38.675242 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:38.679433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:38.680052 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:38.682608 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:38.683052 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:38.683810 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:38.684241 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:38.686503 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:38.686960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:38.687729 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:38.688172 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:38.815048 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:38.820661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:38.823553 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-19c057f5-6721-4fce-853f-38bee5bc43ea tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.153267 May 19 16:48:38.824125 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 296/581] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:38 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:38.829490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1232ad73-079d-4b3d-8cf0-bcb8da3cb79d tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1358 microversion: 2.1 time: 0.153694 May 19 16:48:38.830063 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 286/582] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:38 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:39.066217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:39.066827 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:39.072777 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:39.073255 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:39.074009 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:39.074433 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:39.209332 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:39.217392 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1522b886-4bf9-4312-8de1-34ea50edaa90 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.154994 May 19 16:48:39.217966 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 297/583] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:39 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:39.842189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:39.842947 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:39.845551 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:39.846174 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:39.850543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:39.851007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:39.851812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:39.852255 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:39.859446 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:39.859904 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:39.860682 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:39.861115 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:39.993430 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:39.998061 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:40.001981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e706754b-2705-4e80-a4b0-8f7d42c25dae tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.163734 May 19 16:48:40.002546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 287/584] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:39 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:40.005935 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-626b1d44-8d2b-44d1-9e21-6741169a2252 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1548 microversion: 2.1 time: 0.164145 May 19 16:48:40.006494 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 298/585] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:39 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1548 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:40.022212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:40.023021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:40.029189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.029643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.030395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.030828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.160124 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:40.168175 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6cdbbd11-0f0a-4b59-9e91-bb063db62f53 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1548 microversion: 2.1 time: 0.150404 May 19 16:48:40.168739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 288/586] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:40 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1548 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:40.184110 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:40.187625 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:40.188385 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Searching by: {'deleted': False, 'project_id': '66c1f23fbe114e9885266a0092cca13c'} {{(pid=124123) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 19 16:48:40.194957 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.195438 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.196226 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.196687 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.234614 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:40.235226 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:40.241901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.242355 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.243116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.243562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.285988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.multi_cell_list [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124123) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 19 16:48:40.375016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:40.383023 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-707c225c-0b69-4225-ad39-dba90288df10 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.202590 May 19 16:48:40.383618 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 299/587] 10.222.0.36 () {58 vars in 1124 bytes} [Thu May 19 16:48:40 2022] GET /compute/v2.1/servers => generated 342 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:40.383814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-02b4c64b-1693-4241-bf40-89c805bd38d4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.152902 May 19 16:48:40.384248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 289/588] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:40 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:40.396952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:40.397627 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:40.403729 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.404186 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.404942 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:40.405398 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:40.542907 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:40.550298 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2c2db4d5-74b7-4f8a-9e51-5f6f10015488 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1548 microversion: 2.1 time: 0.157648 May 19 16:48:40.550851 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 300/589] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:40 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1548 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:41.018522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:41.019162 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:41.025718 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:41.026248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:41.027020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:41.027461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:41.157945 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:41.166808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b1b8f518-7b6c-4eb1-befe-c79405819feb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.152215 May 19 16:48:41.167383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 290/590] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:41 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:41.403740 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:41.404350 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:41.410867 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:41.411264 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:41.412677 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:41.413183 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:41.544739 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:41.552824 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ea524be1-54bc-4cd3-8948-8561f508a7e6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.152815 May 19 16:48:41.553434 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 301/591] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:41 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:42.056140 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f6838661-e501-4d08-9733-1c74d96f03bd tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "54852683-c27e-4661-9496-2ca4a621daa3"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:42.057371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f6838661-e501-4d08-9733-1c74d96f03bd tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:42.063893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f6838661-e501-4d08-9733-1c74d96f03bd tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:42.064351 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f6838661-e501-4d08-9733-1c74d96f03bd tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:42.065117 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f6838661-e501-4d08-9733-1c74d96f03bd tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:42.065569 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f6838661-e501-4d08-9733-1c74d96f03bd tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:42.184370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:42.184980 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:42.191091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:42.191548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:42.192361 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:42.192787 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:42.306346 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f6838661-e501-4d08-9733-1c74d96f03bd tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.254508 May 19 16:48:42.311494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 291/592] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:48:42 2022] POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments => generated 194 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:42.334053 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:42.342838 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5e85d4c5-4da5-4a82-8a9d-7d30b42d8042 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.162125 May 19 16:48:42.343329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 302/593] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:42 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:42.571326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:42.572021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:42.578213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:42.578669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:42.579434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:42.579921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:42.710070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:42.718438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-89cdec0c-6301-4db6-b62e-166f29ef9d2f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.151666 May 19 16:48:42.718782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 292/594] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:42 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:43.359765 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:43.360284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:43.367287 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:43.367767 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:43.368531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:43.368960 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:43.504590 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:43.512559 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e4134064-3126-48cb-a229-9c5e0315d34d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.156751 May 19 16:48:43.513118 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 303/595] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:43 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:43.735872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:43.736506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:43.743591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:43.744035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:43.744792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:43.745251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:43.882492 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:43.890691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-483eaeea-a250-4ebe-8674-a214ac544f6c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.158646 May 19 16:48:43.891305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 293/596] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:43 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:44.530179 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:44.530705 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:44.537853 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:44.538307 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:44.539070 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:44.539503 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:44.667793 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:44.675697 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cd964115-2ca1-4777-afe5-54f955dd1c1f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.149491 May 19 16:48:44.676260 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 304/597] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:44 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:44.907845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:44.908455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:44.915238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:44.915694 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:44.916456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:44.916894 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:45.048457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:45.056429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e80fdf45-f862-4874-8420-f02f3135b221 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.152461 May 19 16:48:45.057295 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 294/598] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:44 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:45.693407 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:45.694014 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:45.700437 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:45.700883 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:45.701654 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:45.702085 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:45.835055 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:45.842909 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ea86fd2d-0417-463a-aaa2-2df60da445eb tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1722 microversion: 2.1 time: 0.153866 May 19 16:48:45.843463 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 305/599] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:45 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:46.073936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:46.074457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:46.081174 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:46.081637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:46.082436 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:46.082878 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:46.222834 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:46.231610 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-20fbfa84-6148-4786-91df-d103a378cc14 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.161566 May 19 16:48:46.232188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 295/600] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:46 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:46.860265 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:46.860832 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:46.867450 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:46.867904 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:46.868671 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:46.869106 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:47.003114 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:47.011570 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b1dd3d94-8e58-4312-8bc8-22b21bdf5cfa tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1699 microversion: 2.1 time: 0.155330 May 19 16:48:47.012135 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 306/601] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:46 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1699 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:47.028460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d7f2e9e1-f717-4682-8f8e-49378f0a896e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:47.034587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7f2e9e1-f717-4682-8f8e-49378f0a896e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:47.035039 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7f2e9e1-f717-4682-8f8e-49378f0a896e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:47.039102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:47.059525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d7f2e9e1-f717-4682-8f8e-49378f0a896e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Going to try to start instance {{(pid=124122) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 16:48:47.100576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d7f2e9e1-f717-4682-8f8e-49378f0a896e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action" status: 202 len: 0 microversion: 2.1 time: 0.075830 May 19 16:48:47.101282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 296/602] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:48:47 2022] POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:48:47.109354 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:47.110137 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:47.117047 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:47.117350 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:47.118041 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:47.118473 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:47.250838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:47.251536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:47.258081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:47.258818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:47.259587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:47.260024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:47.287772 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:47.296914 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bfd4d6d5-fc85-45d4-b14d-0416f49da362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1708 microversion: 2.1 time: 0.191286 May 19 16:48:47.297530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 307/603] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:47 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1708 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:47.396391 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:47.404551 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5ca8941d-3762-472b-9871-e46856325f2b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.158170 May 19 16:48:47.405117 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 297/604] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:47 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:48.314158 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:48.314680 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:48.321099 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:48.321571 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:48.322318 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:48.322746 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:48.422250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:48.423003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:48.425563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=66 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:48.431520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:48.431979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:48.432759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:48.433234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:48.451157 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:48.459736 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-715b73ec-bc00-44dd-8a26-ca3b14dd0764 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1708 microversion: 2.1 time: 0.149439 May 19 16:48:48.460322 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 308/605] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:48 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1708 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:48.572977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:48.582455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3c0c9dcc-eff0-47d0-83ac-5e3b515431d0 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.163997 May 19 16:48:48.583028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 298/606] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:48 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:49.477470 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:49.478108 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:49.484506 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:49.484956 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:49.485721 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:49.486151 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:49.599744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:49.600366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:49.606912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:49.607371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:49.608150 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:49.608593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:49.621530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:49.630007 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6efca7fc-8e8e-4b5e-9122-9b8f98a2511f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1712 microversion: 2.1 time: 0.156425 May 19 16:48:49.631177 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 309/607] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:49 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1712 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:49.740136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:49.749756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3cad5496-3842-494a-b9c0-cbd2e9827abe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.153481 May 19 16:48:49.750334 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 299/608] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:49 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:50.767621 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:50.768229 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:50.770108 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:50.771346 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=76 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:50.778591 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:50.779050 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:50.779813 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:50.780242 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:50.914895 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:50.915460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:50.916080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:50.922619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:50.923079 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:50.923189 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-22cf037b-c4a5-41ad-a0de-c4b9b0f0acd4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.159299 May 19 16:48:50.923917 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 310/609] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:50 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:50.924029 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:50.924362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:51.057060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:51.065102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-eaa67916-0a85-4ab3-816e-030f5f9288a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1594 microversion: 2.1 time: 0.153615 May 19 16:48:51.065697 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 300/610] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:50 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1594 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:51.940119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:51.940735 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:51.948087 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:51.948570 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:51.949422 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:51.950076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:52.081845 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:52.084066 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:48:52.091772 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0adec0e2-13d4-4522-b540-23851e899d56 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.155597 May 19 16:48:52.092348 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 311/611] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:51 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:52.995455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-b27dfa74-b44f-4ef9-a975-f91bd8dd9b32 req-0976afa7-ace4-4b2b-aa8f-9a82585e8e71 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c98418-8020-43de-bbc8-d576ea6ef758", "tag": "c605e454-163b-4c14-a9ba-3e1b4b3ddc8a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:53.007826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b27dfa74-b44f-4ef9-a975-f91bd8dd9b32 req-0976afa7-ace4-4b2b-aa8f-9a82585e8e71 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:53.008485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b27dfa74-b44f-4ef9-a975-f91bd8dd9b32 req-0976afa7-ace4-4b2b-aa8f-9a82585e8e71 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:53.022146 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-b27dfa74-b44f-4ef9-a975-f91bd8dd9b32 req-0976afa7-ace4-4b2b-aa8f-9a82585e8e71 service nova] Creating event network-changed:c605e454-163b-4c14-a9ba-3e1b4b3ddc8a for instance c0c98418-8020-43de-bbc8-d576ea6ef758 on hv-cinder-84243 May 19 16:48:53.027372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-b27dfa74-b44f-4ef9-a975-f91bd8dd9b32 req-0976afa7-ace4-4b2b-aa8f-9a82585e8e71 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097263 May 19 16:48:53.028608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 301/612] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:48:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:53.112218 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:53.114466 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:53.127086 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:53.128852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:53.129823 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:53.130862 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:53.356607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:53.365784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e9ddb75d-1ac1-4df4-be4f-2b68ae7be538 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.258996 May 19 16:48:53.366615 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 312/613] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:53 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:53.911278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1755844665"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:53.911891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:53.918706 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:53.919580 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:53.920597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:53.921035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:54.052725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.network.security_group_api [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Adding security group 2c4ed90d-88ea-4f0a-9187-1fc4ed2ea1b6 to port c605e454-163b-4c14-a9ba-3e1b4b3ddc8a May 19 16:48:54.383867 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:54.384593 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:54.391265 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:54.391796 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:54.392699 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:54.393232 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:54.476490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-205e5dd9-a293-4835-b794-f6f7f8047770 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/action" status: 202 len: 0 microversion: 2.1 time: 0.569521 May 19 16:48:54.477238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 302/614] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:48:53 2022] POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/action => generated 0 bytes in 571 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:48:54.485821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:54.486525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:54.499332 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:54.499792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:54.500583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:54.501024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:54.538869 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:54.549845 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-09e192ca-d2ad-4547-9655-7b5101d72e9f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.169641 May 19 16:48:54.551730 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 313/615] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:54 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:54.685879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:54.695120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70ddc34f-d828-499b-9608-ab3cb336580e tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1760 microversion: 2.1 time: 0.213131 May 19 16:48:54.695889 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 303/616] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:54 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1760 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:48:55.043076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-7af1d0e6-f453-4f7b-b1e6-28ebcaa54434 req-5c62fb13-0568-4777-bcde-470757f1f8e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c98418-8020-43de-bbc8-d576ea6ef758", "tag": "c605e454-163b-4c14-a9ba-3e1b4b3ddc8a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:48:55.051329 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-7af1d0e6-f453-4f7b-b1e6-28ebcaa54434 req-5c62fb13-0568-4777-bcde-470757f1f8e8 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:55.051767 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-7af1d0e6-f453-4f7b-b1e6-28ebcaa54434 req-5c62fb13-0568-4777-bcde-470757f1f8e8 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:55.063117 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-7af1d0e6-f453-4f7b-b1e6-28ebcaa54434 req-5c62fb13-0568-4777-bcde-470757f1f8e8 service nova] Creating event network-changed:c605e454-163b-4c14-a9ba-3e1b4b3ddc8a for instance c0c98418-8020-43de-bbc8-d576ea6ef758 on hv-cinder-84243 May 19 16:48:55.068601 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-7af1d0e6-f453-4f7b-b1e6-28ebcaa54434 req-5c62fb13-0568-4777-bcde-470757f1f8e8 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029486 May 19 16:48:55.070082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 314/617] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:48:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:48:55.568528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:55.569192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:55.575569 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:55.576020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:55.576784 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:55.577241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:55.705769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:55.714151 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-652e984b-8e91-43a0-a0e2-cb5439d245db tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.149424 May 19 16:48:55.714719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 304/618] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:55 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:56.732071 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:56.732787 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:56.739402 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:56.739848 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:56.740600 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:56.741643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:56.875912 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:56.883987 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-0210ee18-a6ed-4ad3-bf41-fbf7e2eeb3d9 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.156133 May 19 16:48:56.884548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 315/619] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:56 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:57.901113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:57.901752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:57.908421 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:57.908873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:57.909707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:57.910144 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:58.041789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:58.049755 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-66fcd2e2-47f8-42a8-a202-5afd6c7933e8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.152487 May 19 16:48:58.050354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 305/620] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:57 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:48:59.067525 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:48:59.068127 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:48:59.074824 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:59.075263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:59.076027 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:48:59.076508 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:48:59.212317 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:48:59.220219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9fd9904c-816b-413d-af33-523b4ce52b1b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.156583 May 19 16:48:59.220787 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 316/621] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:48:59 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:00.248537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:00.249375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:00.257428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:00.258890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:00.260224 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:00.260943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:00.394802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:00.402966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-90f8a9d9-27b0-4975-8b52-15f8b2728bbe tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.168833 May 19 16:49:00.403529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 306/622] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:00 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:01.420279 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:01.420888 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:01.427588 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:01.428041 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:01.428808 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:01.429273 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:01.573320 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:01.581531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c01a4162-4123-4031-b8ab-9f6922f60bfd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.165128 May 19 16:49:01.582115 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 317/623] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:01 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:02.598606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:02.599211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:02.606309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:02.606756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:02.607516 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:02.607978 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:02.741370 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:02.751042 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-353af8af-0ddb-4e97-a519-34bb31ac69cd tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.156129 May 19 16:49:02.751621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 307/624] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:02 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:03.770715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:03.771353 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:03.777952 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:03.778401 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:03.779156 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:03.779595 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:03.912915 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:03.921632 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-549496a3-faaf-4994-80be-c65d756f694e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.154743 May 19 16:49:03.922205 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 318/625] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:03 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:04.938898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:04.939497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:04.947444 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:04.947896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:04.949195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:04.949794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:05.094877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:05.103840 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4ef56653-0728-4dec-b639-59aa7f6f3b40 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.168711 May 19 16:49:05.104433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 308/626] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:04 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:06.120964 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:06.121609 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:06.128376 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.128827 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.129625 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.130063 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.262643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:06.271284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c306e117-3cc8-40e5-9171-ad550ca88f27 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.154121 May 19 16:49:06.271855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 319/627] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:06 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:06.433034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-653d8add-6463-4e92-8a43-3b7d6ecf9bdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:06.433554 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-653d8add-6463-4e92-8a43-3b7d6ecf9bdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:06.439621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-653d8add-6463-4e92-8a43-3b7d6ecf9bdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.440071 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-653d8add-6463-4e92-8a43-3b7d6ecf9bdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.440835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-653d8add-6463-4e92-8a43-3b7d6ecf9bdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.441309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-653d8add-6463-4e92-8a43-3b7d6ecf9bdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.463411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-653d8add-6463-4e92-8a43-3b7d6ecf9bdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7/ips" status: 200 len: 149 microversion: 2.1 time: 0.132940 May 19 16:49:06.463895 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 309/628] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:49:06 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7/ips => generated 149 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:06.475232 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "31369114-8f46-44f6-8fa8-037b1672c95e"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:06.476295 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:06.482854 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.483301 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.484052 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.484484 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.562816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Invalid volume: volume 31369114-8f46-44f6-8fa8-037b1672c95e is already attached to instances: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: POST /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7/os-volume_attachments HTTP/1.1 May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 74 May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:49:06.564528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {"volumeAttachment": {"volumeId": "31369114-8f46-44f6-8fa8-037b1672c95e"}} May 19 16:49:06.566169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Invalid volume: volume 31369114-8f46-44f6-8fa8-037b1672c95e is already attached to instances: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'server_id': '23b20a85-cbdd-4162-a605-e79b237afbb7', 'body': {'volumeAttachment': {'volumeId': '31369114-8f46-44f6-8fa8-037b1672c95e'}}} May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 31369114-8f46-44f6-8fa8-037b1672c95e is already attached to instances: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:06.567093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 31369114-8f46-44f6-8fa8-037b1672c95e is already attached to instances: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:06.568531 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 31369114-8f46-44f6-8fa8-037b1672c95e is already attached to instances: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 400 to user: Invalid volume: volume 31369114-8f46-44f6-8fa8-037b1672c95e is already attached to instances: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-deef4ee0-bb85-4f67-994b-093a41f62648 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094693 May 19 16:49:06.570281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 320/629] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:49:06 2022] POST /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 16:49:06.574971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:06.575479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:06.581466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.581918 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.582669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.583129 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.609197 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:49:06.690387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b01d811-5e7b-4d6b-9799-85cc7b1c967f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 204 len: 0 microversion: 2.1 time: 0.118858 May 19 16:49:06.690977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 310/630] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:49:06 2022] DELETE /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:49:06.699865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:06.700473 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:06.707221 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.707666 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.708548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:06.708984 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:06.843091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:06.850540 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9df2ca14-ea59-4da5-9bfa-af2725cff2fe tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1680 microversion: 2.1 time: 0.155107 May 19 16:49:06.851135 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 321/631] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:06 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1680 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:07.292881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:07.293684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:07.301876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:07.302332 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:07.303275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:07.303537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:07.322899 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:07.453540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:07.462177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e7ca476a-a7c4-4902-9933-b7907c1726f4 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1736 microversion: 2.1 time: 0.175921 May 19 16:49:07.462746 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 311/632] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:07 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1736 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:07.867816 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:07.868463 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:07.875756 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:07.876201 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:07.876967 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:07.877496 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.006750 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:08.014216 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e3d07a26-fa44-4cb3-99de-73c79b14fedf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1680 microversion: 2.1 time: 0.150305 May 19 16:49:08.014782 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 322/633] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:07 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1680 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:08.480074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:08.480687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:08.487219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.487669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.488425 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.488857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.625552 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:08.633999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-80bacfd1-5dcf-4ce4-bf80-fc778b4cdca2 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1716 microversion: 2.1 time: 0.158273 May 19 16:49:08.637335 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 312/634] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:08 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1716 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:08.704818 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:08.705377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:08.711532 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.711980 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.712741 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.713194 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.794523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] HTTP exception thrown: Cannot 'detach_volume' instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 while it is in vm_state rescued May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Request method failure captured: May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: DELETE /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments/bf404241-ba86-419f-8f0a-962f86c3d36e HTTP/1.1 May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOdf_UrMrp5CunZyL8epnfGmidIgSd38Jxi6Nt0UzwimlAQmRoF2t99JizNDeT69ZbhLMxKD9tr9meqBwL9LUAsjM8ValOvUnMX_KaCJO4elB1SwDEplk74cwCe_9oGe_PZCqhHwrGNQtp9CZsSp3hK-NYkgIHwPcoknV4M4zxyPB0 May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:49:08.796030 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3fbe05607bf945bbb756e7ed3764cccc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 6e88db1bf9294decaf171756772a5066 May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:49:08.797425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Cannot 'detach_volume' instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 while it is in vm_state rescued May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'server_id': 'deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5', 'id': 'bf404241-ba86-419f-8f0a-962f86c3d36e'} May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:49:08.801284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 while it is in vm_state rescued May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 while it is in vm_state rescued May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:08.802703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Returning 409 to user: Cannot 'detach_volume' instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 while it is in vm_state rescued {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:49:08.803855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-f4dfc5ca-9565-4a7f-8d36-3350ee5d477f tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments/bf404241-ba86-419f-8f0a-962f86c3d36e" status: 409 len: 152 microversion: 2.1 time: 0.096681 May 19 16:49:08.803855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 323/635] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:49:08 2022] DELETE /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments/bf404241-ba86-419f-8f0a-962f86c3d36e => generated 152 bytes in 98 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 19 16:49:08.806217 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ec57b517-1462-47f8-a37e-91c92124031d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:08.806747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ec57b517-1462-47f8-a37e-91c92124031d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:08.812704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec57b517-1462-47f8-a37e-91c92124031d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.813161 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec57b517-1462-47f8-a37e-91c92124031d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.813930 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec57b517-1462-47f8-a37e-91c92124031d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.814390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ec57b517-1462-47f8-a37e-91c92124031d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.883930 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ec57b517-1462-47f8-a37e-91c92124031d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "POST /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/action" status: 202 len: 0 microversion: 2.1 time: 0.081217 May 19 16:49:08.884912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 313/636] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:49:08 2022] POST /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/action => generated 0 bytes in 83 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:49:08.898302 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:08.899370 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:08.906669 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.907119 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:08.907886 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:08.908310 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:09.033465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:09.034362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:09.041350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:09.041802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:09.042723 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:09.043160 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:09.044048 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:09.052274 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b263c0ce-419f-49e6-afc2-79710582474e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1724 microversion: 2.1 time: 0.159836 May 19 16:49:09.052931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 324/637] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:08 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:09.173608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:09.181198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ece56475-5403-4156-9875-007ec78bf8c0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1680 microversion: 2.1 time: 0.152838 May 19 16:49:09.181764 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 314/638] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:09 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:49:10.074655 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:10.076374 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:10.087240 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:10.088274 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:10.089629 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:10.090434 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:10.198672 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:10.199347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:10.212414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:10.222354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:10.223565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:10.224126 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:10.327249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:10.339678 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-357addde-cba8-4e8c-b149-76d2df3ff011 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1613 microversion: 2.1 time: 0.145450 May 19 16:49:10.341014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 315/639] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:10 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1613 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:10.492201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-ffba5fef-2abd-46aa-a497-87d22e40cc42 req-955afba7-2ef6-480e-8f7e-39512b40d74f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "23b20a85-cbdd-4162-a605-e79b237afbb7", "name": "network-vif-deleted", "tag": "7c85e1d9-2cb2-4a72-afa4-30d08738ec7f"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:10.503147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ffba5fef-2abd-46aa-a497-87d22e40cc42 req-955afba7-2ef6-480e-8f7e-39512b40d74f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:10.503943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ffba5fef-2abd-46aa-a497-87d22e40cc42 req-955afba7-2ef6-480e-8f7e-39512b40d74f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:10.517121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-ffba5fef-2abd-46aa-a497-87d22e40cc42 req-955afba7-2ef6-480e-8f7e-39512b40d74f service nova] Creating event network-vif-deleted:7c85e1d9-2cb2-4a72-afa4-30d08738ec7f for instance 23b20a85-cbdd-4162-a605-e79b237afbb7 on hv-cinder-84243 May 19 16:49:10.523721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-ffba5fef-2abd-46aa-a497-87d22e40cc42 req-955afba7-2ef6-480e-8f7e-39512b40d74f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035120 May 19 16:49:10.524966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 316/640] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:10.561262 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:10.571236 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7da91ca3-43e2-4b07-a14b-df5230bfae8b tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1724 microversion: 2.1 time: 0.503768 May 19 16:49:10.574234 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 325/641] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:10 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1724 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:11.359544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:11.360257 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:11.367556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:11.368006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:11.368790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:11.369447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:11.404025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:11.404481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:11.405080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lazy-loading 'fault' on Instance uuid 23b20a85-cbdd-4162-a605-e79b237afbb7 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:49:11.452655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:11.461137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9ede6716-dc40-49f8-a302-54603b3aad3a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1331 microversion: 2.1 time: 0.105636 May 19 16:49:11.462156 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 317/642] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:11 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1331 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:11.591395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:11.592105 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:11.598967 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:11.599492 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:11.600348 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:11.600857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:11.731410 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:11.739400 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-eddc0997-7bc0-4d6d-a71b-5e60a100cf30 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1724 microversion: 2.1 time: 0.154359 May 19 16:49:11.739982 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 326/643] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:11 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:12.479260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:12.479855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:12.486882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:12.487340 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:12.488137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:12.488576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:12.520867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:12.521346 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:12.521795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lazy-loading 'fault' on Instance uuid 23b20a85-cbdd-4162-a605-e79b237afbb7 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:49:12.561949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:12.570471 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8b715f02-016d-4199-89e7-48d808a1551c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 200 len: 1331 microversion: 2.1 time: 0.095557 May 19 16:49:12.571062 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 318/644] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:12 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:12.756984 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:12.757628 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:12.764523 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:12.764970 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:12.765765 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:12.766200 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:12.906946 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:12.915501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ae28652e-facf-48f2-b438-8c6504ad6733 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1724 microversion: 2.1 time: 0.162351 May 19 16:49:12.916086 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 327/645] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:12 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:13.587256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:13.587950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:13.594301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:13.594761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:13.595503 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:13.595937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:13.612424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 HTTP/1.1 May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:49:13.614102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:49:13.615603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '23b20a85-cbdd-4162-a605-e79b237afbb7'} May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:49:13.616549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:49:13.618605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:49:13.619976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:49:13.619976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9e62d909-3bd5-4742-9fb5-bac94a8efde6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 404 len: 111 microversion: 2.1 time: 0.032270 May 19 16:49:13.619976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 319/646] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:13 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:49:13.625308 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-71c617a8-434f-4688-bb53-2d964b31731d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '.version_select at 0x7f48934eddc0>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:13.646087 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-71c617a8-434f-4688-bb53-2d964b31731d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-816525665" status: 202 len: 0 microversion: 2.1 time: 0.024910 May 19 16:49:13.646732 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 328/647] 10.222.0.36 () {58 vars in 1217 bytes} [Thu May 19 16:49:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-816525665 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:49:13.934574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:13.935200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:13.941198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:13.941840 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:13.942606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:13.943041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:14.076181 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:14.086781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-947a1ab6-5223-48e2-89f6-e822875aae1a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1730 microversion: 2.1 time: 0.157406 May 19 16:49:14.087388 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 320/648] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:13 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:14.105643 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b92a4747-c09b-4c51-9b7a-fbd2efe3f0d1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:14.106217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b92a4747-c09b-4c51-9b7a-fbd2efe3f0d1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:14.112160 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b92a4747-c09b-4c51-9b7a-fbd2efe3f0d1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:14.112608 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b92a4747-c09b-4c51-9b7a-fbd2efe3f0d1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:14.113395 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b92a4747-c09b-4c51-9b7a-fbd2efe3f0d1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:14.113834 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b92a4747-c09b-4c51-9b7a-fbd2efe3f0d1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:14.227045 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b92a4747-c09b-4c51-9b7a-fbd2efe3f0d1 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.126396 May 19 16:49:14.227670 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 329/649] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:49:14 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-interface => generated 285 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:14.380666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:14.381177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:14.388137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:14.388591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:14.389392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:14.389835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:14.514643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lazy-loading 'services' on Instance uuid b4ff377c-5ccd-40ca-9e51-6bde8aafab8c {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:49:14.627464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-83ee2126-370d-4e4f-8caf-68a028f00a04 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments/31369114-8f46-44f6-8fa8-037b1672c95e" status: 202 len: 0 microversion: 2.1 time: 0.250512 May 19 16:49:14.631526 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 321/650] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:49:14 2022] DELETE /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments/31369114-8f46-44f6-8fa8-037b1672c95e => generated 0 bytes in 256 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:49:14.644931 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ebb80f52-7cc5-42ca-baee-369b10434058 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:14.645959 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ebb80f52-7cc5-42ca-baee-369b10434058 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:14.655051 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ebb80f52-7cc5-42ca-baee-369b10434058 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:14.655577 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ebb80f52-7cc5-42ca-baee-369b10434058 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:14.656299 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ebb80f52-7cc5-42ca-baee-369b10434058 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:14.656728 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ebb80f52-7cc5-42ca-baee-369b10434058 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:14.683639 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=100 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:14.703156 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ebb80f52-7cc5-42ca-baee-369b10434058 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.069896 May 19 16:49:14.703988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 330/651] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:49:14 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments => generated 197 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:15.108421 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-a87f5bf4-2968-4368-8024-9056a7faa0b7 req-83177c4d-13e4-40c8-a824-b543a12d5ff0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5", "tag": "dc7ca7c9-fb4e-427b-a711-3641b6dc9306"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:15.118015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a87f5bf4-2968-4368-8024-9056a7faa0b7 req-83177c4d-13e4-40c8-a824-b543a12d5ff0 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:15.118539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a87f5bf4-2968-4368-8024-9056a7faa0b7 req-83177c4d-13e4-40c8-a824-b543a12d5ff0 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:15.131276 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-a87f5bf4-2968-4368-8024-9056a7faa0b7 req-83177c4d-13e4-40c8-a824-b543a12d5ff0 service nova] Creating event network-changed:dc7ca7c9-fb4e-427b-a711-3641b6dc9306 for instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 on hv-cinder-84243 May 19 16:49:15.137590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-a87f5bf4-2968-4368-8024-9056a7faa0b7 req-83177c4d-13e4-40c8-a824-b543a12d5ff0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033054 May 19 16:49:15.138428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 322/652] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:15.715122 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d2c8e85c-49c4-453d-ba1f-8768bc1411c1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:15.716067 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d2c8e85c-49c4-453d-ba1f-8768bc1411c1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:15.722855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2c8e85c-49c4-453d-ba1f-8768bc1411c1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:15.723302 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2c8e85c-49c4-453d-ba1f-8768bc1411c1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:15.724095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2c8e85c-49c4-453d-ba1f-8768bc1411c1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:15.724611 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2c8e85c-49c4-453d-ba1f-8768bc1411c1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:15.763942 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d2c8e85c-49c4-453d-ba1f-8768bc1411c1 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.053035 May 19 16:49:15.764518 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 331/653] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:49:15 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 16:49:15.822986 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:15.823666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:15.830377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:15.830837 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:15.831638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:15.832077 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:15.858506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:49:15.945854 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2c46c2cf-2108-4304-8b99-4d3180ccbe5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 204 len: 0 microversion: 2.1 time: 0.127256 May 19 16:49:15.947593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 323/654] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:49:15 2022] DELETE /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 16:49:15.956226 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:15.957180 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:15.963586 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:15.964043 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:15.964852 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:15.965548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:16.106091 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:16.113671 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8fe4e36f-b1f1-4ebb-9816-87f3e7a516f5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1681 microversion: 2.1 time: 0.161752 May 19 16:49:16.114233 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 332/655] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:15 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:49:17.132549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:17.133350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:17.140993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:17.141484 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:17.142269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:17.142711 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:17.291717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-2f51cece-c736-4904-b52c-9eaf7615360a req-77e40293-fc7d-4d27-a7f6-80794dfa8cd9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5", "tag": "dc7ca7c9-fb4e-427b-a711-3641b6dc9306"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:17.300477 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-2f51cece-c736-4904-b52c-9eaf7615360a req-77e40293-fc7d-4d27-a7f6-80794dfa8cd9 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:17.300912 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-2f51cece-c736-4904-b52c-9eaf7615360a req-77e40293-fc7d-4d27-a7f6-80794dfa8cd9 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:17.313890 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-2f51cece-c736-4904-b52c-9eaf7615360a req-77e40293-fc7d-4d27-a7f6-80794dfa8cd9 service nova] Creating event network-changed:dc7ca7c9-fb4e-427b-a711-3641b6dc9306 for instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 on hv-cinder-84243 May 19 16:49:17.319583 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-2f51cece-c736-4904-b52c-9eaf7615360a req-77e40293-fc7d-4d27-a7f6-80794dfa8cd9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031299 May 19 16:49:17.320170 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 333/656] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:49:17.479857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:17.487522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a7dca791-7e3c-4814-9c27-320056749687 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 200 len: 1681 microversion: 2.1 time: 0.359170 May 19 16:49:17.488109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 324/657] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:17 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 1681 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:18.507008 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:18.509218 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:18.518162 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:18.518772 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:18.520020 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:18.520557 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:18.537045 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c HTTP/1.1 May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:49:18.538771 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:49:18.540700 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'b4ff377c-5ccd-40ca-9e51-6bde8aafab8c'} May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:49:18.541478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:49:18.542605 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:18.543679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:49:18.543679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1c9990be-066e-4be1-81a9-74a97fd18dc3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 404 len: 111 microversion: 2.1 time: 0.039855 May 19 16:49:18.543679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 334/658] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:18 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:49:18.550561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0b183c23-395e-439f-b347-90a41765fef3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '.version_select at 0x7f4893650f70>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:18.553779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR oslo.messaging._drivers.impl_rabbit [None req-0b183c23-395e-439f-b347-90a41765fef3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [55f073d6-f77f-4e25-b09a-1bec8a3d4930] AMQP server on 10.222.0.36:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 19 16:49:19.340663 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-26ddc0ce-cd36-4024-89f1-64fb9309d9f9 req-92e43a4b-7afa-4b0a-b734-991a6972ee7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4ff377c-5ccd-40ca-9e51-6bde8aafab8c", "name": "network-vif-deleted", "tag": "72dbf905-0954-48c4-90e4-39059b98309a"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:19.348704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-26ddc0ce-cd36-4024-89f1-64fb9309d9f9 req-92e43a4b-7afa-4b0a-b734-991a6972ee7b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:19.349143 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-26ddc0ce-cd36-4024-89f1-64fb9309d9f9 req-92e43a4b-7afa-4b0a-b734-991a6972ee7b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:19.359803 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-26ddc0ce-cd36-4024-89f1-64fb9309d9f9 req-92e43a4b-7afa-4b0a-b734-991a6972ee7b service nova] Creating event network-vif-deleted:72dbf905-0954-48c4-90e4-39059b98309a for instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c on hv-cinder-84243 May 19 16:49:19.364517 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-26ddc0ce-cd36-4024-89f1-64fb9309d9f9 req-92e43a4b-7afa-4b0a-b734-991a6972ee7b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028083 May 19 16:49:19.365077 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 335/659] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:49:19.561350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [None req-0b183c23-395e-439f-b347-90a41765fef3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [55f073d6-f77f-4e25-b09a-1bec8a3d4930] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 39980. May 19 16:49:19.567455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:19.582354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0b183c23-395e-439f-b347-90a41765fef3 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-880856713" status: 202 len: 0 microversion: 2.1 time: 1.036243 May 19 16:49:19.582861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 325/660] 10.222.0.36 () {58 vars in 1217 bytes} [Thu May 19 16:49:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-880856713 => generated 0 bytes in 1037 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:49:20.210530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6732e553-98c2-45e3-b235-d5bfd5802dbd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: .version_select at 0x7f489352daf0>, body: {"keypair": {"name": "tempest-keypair-1964442468", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNIs9BbB/lr3eswQHLDo22G+Y0sj2HlqjlmV/zJ3ha2Szwcl8WsMF1NhgvjIzRUEZlhFzLjK0rtwjJy4TQd2h6naCM9YDdVS9giKmWjTox38gcjFgNAo8jWqdu1nIFZC+A=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:20.224849 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-6732e553-98c2-45e3-b235-d5bfd5802dbd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:49:20.229387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-6732e553-98c2-45e3-b235-d5bfd5802dbd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:49:20.250579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6732e553-98c2-45e3-b235-d5bfd5802dbd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044787 May 19 16:49:20.251371 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 336/661] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:49:20 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:21.515838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1555190231", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84ed37a0-33b7-474f-8c60-1eac20f29b87"}], "security_groups": [{"name": "tempest-securitygroup--365936875"}], "key_name": "tempest-keypair-1964442468", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:21.620068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] validate_networks() for [('84ed37a0-33b7-474f-8c60-1eac20f29b87', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:49:22.028762 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:49:22.029246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:49:22.029716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:49:22.030122 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:49:22.030528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:49:22.039159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:22.040251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:22.041092 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:22.041557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:22.058541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:49:22.062418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:49:22.073807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:49:22.076075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:49:22.123001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-eb61ec99-74be-41b5-8614-8ac1a79a73c6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.611898 May 19 16:49:22.123897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 326/662] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:49:21 2022] POST /compute/v2.1/servers => generated 401 bytes in 613 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:49:22.135176 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6a0bc43a-6066-4a7c-a604-5d6656b87e6c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:22.136031 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6a0bc43a-6066-4a7c-a604-5d6656b87e6c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:22.138192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=64,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:22.194267 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6a0bc43a-6066-4a7c-a604-5d6656b87e6c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:22.202954 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6a0bc43a-6066-4a7c-a604-5d6656b87e6c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1242 microversion: 2.1 time: 0.072743 May 19 16:49:22.203620 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 337/663] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:22 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1242 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:23.220236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:23.220855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:23.227866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:23.228354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:23.229121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:23.229587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:23.298576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:23.300752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:23.307111 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-042204ca-b000-4e62-bb93-a5d7b3d86069 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1300 microversion: 2.1 time: 0.091258 May 19 16:49:23.307687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 327/664] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:23 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1300 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:24.324504 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:24.325758 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:24.332157 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:24.332618 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:24.333428 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:24.333871 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:24.479979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:24.488037 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8218d4cc-d9d4-40d9-b5a1-3eac24b41165 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.167933 May 19 16:49:24.488695 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 338/665] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:24 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:24.529745 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-2bc837a6-962b-4075-8486-15b8b9810194 req-1366c3c3-c4be-4734-aac7-af3c4d7f20d9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9cc1c6-d6f1-41fb-b66f-cc33947583d6", "tag": "43573c61-29c1-4b6b-bc49-e94f505da8b8"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:24.554072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2bc837a6-962b-4075-8486-15b8b9810194 req-1366c3c3-c4be-4734-aac7-af3c4d7f20d9 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:24.554519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2bc837a6-962b-4075-8486-15b8b9810194 req-1366c3c3-c4be-4734-aac7-af3c4d7f20d9 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:24.566626 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-2bc837a6-962b-4075-8486-15b8b9810194 req-1366c3c3-c4be-4734-aac7-af3c4d7f20d9 service nova] Creating event network-changed:43573c61-29c1-4b6b-bc49-e94f505da8b8 for instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 on hv-cinder-84243 May 19 16:49:24.572908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-2bc837a6-962b-4075-8486-15b8b9810194 req-1366c3c3-c4be-4734-aac7-af3c4d7f20d9 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048076 May 19 16:49:24.573539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 328/666] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:25.507857 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:25.508525 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:25.515413 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:25.515859 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:25.516612 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:25.517041 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:25.650276 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:25.657601 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d6cb0444-bb41-4b7a-9606-236cd1e199c2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.153557 May 19 16:49:25.658164 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 339/667] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:25 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:26.674720 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:26.675417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:26.683744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:26.684193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:26.684952 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:26.685515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:26.817641 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:26.826133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6e533636-f0b0-4a6e-9599-5330f03a10cc tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.155504 May 19 16:49:26.826687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 329/668] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:26 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:49:27.842936 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:27.843647 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:27.850326 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:27.850853 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:27.851632 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:27.852106 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:27.990529 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:27.999717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-052c4e41-f21d-480f-aeb1-4b7e4a59f351 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.160608 May 19 16:49:28.000310 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 340/669] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:27 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:29.017070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:29.017707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:29.025051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:29.025541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:29.026313 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:29.026753 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:29.155766 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:29.163307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cc9677c5-7d5b-4379-aae9-c698fd5d628a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.150054 May 19 16:49:29.163875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 330/670] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:29 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:30.179761 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:30.180372 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:30.186888 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:30.187332 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:30.188082 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:30.188509 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:30.325452 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:30.332914 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-476e0764-0922-4a43-86ba-90f48a2d274c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.156982 May 19 16:49:30.333749 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 341/671] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:30 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:31.350277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:31.350828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:31.357457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:31.357906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:31.358664 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:31.359096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:31.494429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:31.502722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2f0f185c-3c36-426d-ac94-d70e3ead9db8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.156335 May 19 16:49:31.503289 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 331/672] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:31 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:31.842223 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-cdec536f-77e9-45fa-8c23-f737df5b2fc3 req-1749f049-285c-4fbf-a2fd-da25904460d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9cc1c6-d6f1-41fb-b66f-cc33947583d6", "name": "network-vif-plugged", "status": "completed", "tag": "43573c61-29c1-4b6b-bc49-e94f505da8b8"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:31.850623 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-cdec536f-77e9-45fa-8c23-f737df5b2fc3 req-1749f049-285c-4fbf-a2fd-da25904460d4 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:31.851325 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-cdec536f-77e9-45fa-8c23-f737df5b2fc3 req-1749f049-285c-4fbf-a2fd-da25904460d4 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:31.862822 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-cdec536f-77e9-45fa-8c23-f737df5b2fc3 req-1749f049-285c-4fbf-a2fd-da25904460d4 service nova] Creating event network-vif-plugged:43573c61-29c1-4b6b-bc49-e94f505da8b8 for instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 on hv-cinder-84243 May 19 16:49:31.867840 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-cdec536f-77e9-45fa-8c23-f737df5b2fc3 req-1749f049-285c-4fbf-a2fd-da25904460d4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.092370 May 19 16:49:31.868491 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 342/673] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:32.520296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:32.520848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:32.522855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:32.523667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:32.530740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:32.531195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:32.531961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:32.532401 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:32.660595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:32.668499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bdabf575-9b66-4fee-96f1-da60f6b086fd tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1367 microversion: 2.1 time: 0.152310 May 19 16:49:32.669055 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 332/674] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:32 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:33.682751 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=6 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:33.687415 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:33.688117 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:33.694984 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:33.695481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:33.696232 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:33.696699 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:33.827679 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:33.835005 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-18fbd01a-973d-4ace-9ea6-1fa3e89c04eb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1556 microversion: 2.1 time: 0.153265 May 19 16:49:33.835561 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 343/675] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:33 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:33.851422 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c51dd8b3-146f-42fc-846d-43e695234b0c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:33.851912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c51dd8b3-146f-42fc-846d-43e695234b0c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:33.863572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c51dd8b3-146f-42fc-846d-43e695234b0c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:33.864020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c51dd8b3-146f-42fc-846d-43e695234b0c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:33.864789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c51dd8b3-146f-42fc-846d-43e695234b0c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:33.865279 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c51dd8b3-146f-42fc-846d-43e695234b0c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:33.946748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c51dd8b3-146f-42fc-846d-43e695234b0c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.099149 May 19 16:49:33.947339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 333/676] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:49:33 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-interface => generated 284 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:34.863542 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-f084f417-6584-42ae-9069-b73566fd0f97 req-c33f63e6-3bf1-48a2-86bc-a7af09cdcda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5b9cc1c6-d6f1-41fb-b66f-cc33947583d6", "tag": "43573c61-29c1-4b6b-bc49-e94f505da8b8"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:34.872743 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f084f417-6584-42ae-9069-b73566fd0f97 req-c33f63e6-3bf1-48a2-86bc-a7af09cdcda7 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:34.873534 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-f084f417-6584-42ae-9069-b73566fd0f97 req-c33f63e6-3bf1-48a2-86bc-a7af09cdcda7 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:34.884254 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-f084f417-6584-42ae-9069-b73566fd0f97 req-c33f63e6-3bf1-48a2-86bc-a7af09cdcda7 service nova] Creating event network-changed:43573c61-29c1-4b6b-bc49-e94f505da8b8 for instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 on hv-cinder-84243 May 19 16:49:34.889933 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-f084f417-6584-42ae-9069-b73566fd0f97 req-c33f63e6-3bf1-48a2-86bc-a7af09cdcda7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029993 May 19 16:49:34.890769 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 344/677] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:42.212514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d3d611b0-1c53-4a80-a6c3-ede595050116 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:42.213082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d3d611b0-1c53-4a80-a6c3-ede595050116 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:42.219208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d3d611b0-1c53-4a80-a6c3-ede595050116 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:42.219662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d3d611b0-1c53-4a80-a6c3-ede595050116 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:42.220428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d3d611b0-1c53-4a80-a6c3-ede595050116 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:42.220871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d3d611b0-1c53-4a80-a6c3-ede595050116 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:42.250051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d3d611b0-1c53-4a80-a6c3-ede595050116 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments/6a776be6-be5d-4157-b926-1da7ef38fcd1" status: 200 len: 194 microversion: 2.20 time: 0.042475 May 19 16:49:42.250627 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 334/678] 10.222.0.36 () {60 vars in 1453 bytes} [Thu May 19 16:49:42 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments/6a776be6-be5d-4157-b926-1da7ef38fcd1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:49:42.314036 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:42.314614 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:42.320773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:42.321251 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:42.322002 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:42.322429 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:42.402399 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lazy-loading 'services' on Instance uuid 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:49:42.473425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-732deb28-b128-4f36-83e6-c20f7159b773 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments/6a776be6-be5d-4157-b926-1da7ef38fcd1" status: 202 len: 0 microversion: 2.20 time: 0.163862 May 19 16:49:42.473934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 345/679] 10.222.0.36 () {60 vars in 1456 bytes} [Thu May 19 16:49:42 2022] DELETE /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments/6a776be6-be5d-4157-b926-1da7ef38fcd1 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 16:49:42.482659 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-de1107f0-b0ac-4607-88a0-d7becda0d1a3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:42.483671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-de1107f0-b0ac-4607-88a0-d7becda0d1a3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:42.489741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de1107f0-b0ac-4607-88a0-d7becda0d1a3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:42.490193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de1107f0-b0ac-4607-88a0-d7becda0d1a3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:42.491015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de1107f0-b0ac-4607-88a0-d7becda0d1a3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:42.491459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de1107f0-b0ac-4607-88a0-d7becda0d1a3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:42.522793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-de1107f0-b0ac-4607-88a0-d7becda0d1a3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044503 May 19 16:49:42.523543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 335/680] 10.222.0.36 () {60 vars in 1342 bytes} [Thu May 19 16:49:42 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:49:43.537607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-38face73-3de8-46a0-96b1-aee29f57d837 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:43.538580 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-38face73-3de8-46a0-96b1-aee29f57d837 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:43.544883 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38face73-3de8-46a0-96b1-aee29f57d837 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:43.545366 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38face73-3de8-46a0-96b1-aee29f57d837 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:43.546116 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38face73-3de8-46a0-96b1-aee29f57d837 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:43.546545 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-38face73-3de8-46a0-96b1-aee29f57d837 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:43.575906 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-38face73-3de8-46a0-96b1-aee29f57d837 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.044437 May 19 16:49:43.576446 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 346/681] 10.222.0.36 () {60 vars in 1342 bytes} [Thu May 19 16:49:43 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:43.634193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:43.634686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:43.641271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:43.641726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:43.642491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:43.642933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:43.668366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:49:43.740623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1a2cf9e9-5b1c-425f-b0d9-b6798e215b2d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 204 len: 0 microversion: 2.20 time: 0.110040 May 19 16:49:43.741239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 336/682] 10.222.0.36 () {60 vars in 1279 bytes} [Thu May 19 16:49:43 2022] DELETE /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 16:49:43.750712 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:43.751332 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:43.757463 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:43.757915 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:43.758673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:43.759107 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:43.894589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:43.903393 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:43.904913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:43.906112 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d8105a66-55d7-496d-b231-5dbb0444d33b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.160415 May 19 16:49:43.906674 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 347/683] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:43 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:44.925571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:44.926191 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:44.933271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:44.933750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:44.934521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:44.934981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:45.072462 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:45.080456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:45.082008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:45.083176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a8d62742-0304-48df-9815-f6d69a9b45d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.161997 May 19 16:49:45.083734 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 337/684] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:44 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:46.102074 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:46.102639 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:46.109924 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:46.110377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:46.111145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:46.111584 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:46.114325 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=77,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:46.256562 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:46.268242 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:46.271448 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:46.272648 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-66b576b3-c88d-4388-99a3-342b4d33127c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 200 len: 1722 microversion: 2.20 time: 0.174750 May 19 16:49:46.273217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 348/685] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:46 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:46.640725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-62ece957-5426-4112-b3ce-350acb49d4ad req-dc3102d7-2089-47b0-b8ce-990b01db756a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a6d6a59-35a3-46b0-a92a-a3ae729071b7", "name": "network-vif-deleted", "tag": "5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:46.663266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-62ece957-5426-4112-b3ce-350acb49d4ad req-dc3102d7-2089-47b0-b8ce-990b01db756a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:46.664125 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-62ece957-5426-4112-b3ce-350acb49d4ad req-dc3102d7-2089-47b0-b8ce-990b01db756a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:46.681120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-62ece957-5426-4112-b3ce-350acb49d4ad req-dc3102d7-2089-47b0-b8ce-990b01db756a service nova] Creating event network-vif-deleted:5b6fd4e1-0dc2-4219-9598-c49bccf6cbfc for instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 on hv-cinder-84243 May 19 16:49:46.686051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-62ece957-5426-4112-b3ce-350acb49d4ad req-dc3102d7-2089-47b0-b8ce-990b01db756a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051316 May 19 16:49:46.687082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 338/686] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:49:47.294630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:47.295240 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:47.301888 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:47.302333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:47.303094 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:47.303521 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:47.317961 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] HTTP exception thrown: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Request method failure captured: May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 HTTP/1.1 May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOjmR4HZtXBD3Sz12dQYTY0RZpc5zZzjp50yFFwL81AsEBpfMxffLBh0sgWCvJC2qU8NyyD0kmOO_3kkPebbc2uZDm3YGtR22IyRKBj8hdv7-FKeXW6LV71UcH6N2zC5R5M_PQb8sobeio7MS_bKtM8pcjJR4C9iTqDfk5TNJrOL3U May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Openstack-Nova-Api-Version: 2.20 May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:49:47.319660 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bef5d1b475ef4228a77b87964b0b8ce1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 86b78ffb46894509bf8e81a154073885 May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:49:47.321341 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': '3a6d6a59-35a3-46b0-a92a-a3ae729071b7'} May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:49:47.322145 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:49:47.324305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:49:47.325744 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Returning 404 to user: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:49:47.325744 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bf51995b-bbef-4d25-96e6-1c42443b5cb9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 404 len: 111 microversion: 2.20 time: 0.030397 May 19 16:49:47.325744 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 349/687] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:47 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 16:49:47.331443 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7a3b9c0e-610d-4b4a-8b4d-f015fb9aa0f2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '.version_select at 0x7f489369c1f0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:47.350989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7a3b9c0e-610d-4b4a-8b4d-f015fb9aa0f2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776713100" status: 204 len: 0 microversion: 2.20 time: 0.023759 May 19 16:49:47.351695 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 339/688] 10.222.0.36 () {60 vars in 1261 bytes} [Thu May 19 16:49:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1776713100 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 16:49:48.018967 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-7aa8da4d-4226-49eb-b17f-d33048f5e942 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'create', calling method: .version_select at 0x7f48934f8430>, body: {"keypair": {"name": "tempest-keypair-817010839", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBATvTJE3DdT2otHBnC9w4UvoqofHF2BRcxoSH4xy+odm1P+lAwAM+ocH1rUmAfQgiErX6Xhvu9xNX639qSKnAqvvbveULIa7XVagNZcUKZSl5IbaxL5qacWRZ75zvpXtZg=="}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:48.033062 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-7aa8da4d-4226-49eb-b17f-d33048f5e942 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:49:48.036916 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.quota [None req-7aa8da4d-4226-49eb-b17f-d33048f5e942 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for user 86b78ffb46894509bf8e81a154073885 and project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'key_pairs'} {{(pid=124123) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:49:48.058364 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-7aa8da4d-4226-49eb-b17f-d33048f5e942 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.043328 May 19 16:49:48.058944 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 350/689] 10.222.0.36 () {62 vars in 1199 bytes} [Thu May 19 16:49:48 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 45 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 19 16:49:49.289566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1032567184", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5bf6144a-4dd4-4703-91b7-ee3e7d7d485e"}], "security_groups": [{"name": "tempest-securitygroup--675039433"}], "key_name": "tempest-keypair-817010839", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:49.393506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] validate_networks() for [('5bf6144a-4dd4-4703-91b7-ee3e7d7d485e', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:49:49.782606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=52,nova_api:DELETE=2,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:49.972114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:49:49.972665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:49:49.973145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:49:49.973592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:49:49.974007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:49:49.982739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:49.983220 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:49.984017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:49.984457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:50.001377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:49:50.005315 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Getting quotas for user 86b78ffb46894509bf8e81a154073885 and project bef5d1b475ef4228a77b87964b0b8ce1. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:49:50.016831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:49:50.019199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:49:50.064324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-04e6d338-de42-49c1-93be-d2445635cfcb tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.779035 May 19 16:49:50.064969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 340/690] 10.222.0.36 () {62 vars in 1187 bytes} [Thu May 19 16:49:49 2022] POST /compute/v2.1/servers => generated 401 bytes in 780 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 19 16:49:50.076262 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-1d80ef28-8cb3-403b-9588-39e256ad1a9c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:50.077247 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-1d80ef28-8cb3-403b-9588-39e256ad1a9c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:50.136117 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1d80ef28-8cb3-403b-9588-39e256ad1a9c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:50.143828 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1d80ef28-8cb3-403b-9588-39e256ad1a9c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:50.145473 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-1d80ef28-8cb3-403b-9588-39e256ad1a9c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:50.146650 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-1d80ef28-8cb3-403b-9588-39e256ad1a9c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1281 microversion: 2.20 time: 0.075587 May 19 16:49:50.147273 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 351/691] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:50 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1281 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:51.164145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:51.164753 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:51.172305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:51.172756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:51.173539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:51.173976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:51.235325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:51.243210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:51.244730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:51.245857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d0144ed9-be3f-4091-b4ef-703aea6e7222 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1339 microversion: 2.20 time: 0.086066 May 19 16:49:51.246411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 341/692] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:51 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1339 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:52.264784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:52.264784 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:52.266891 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:52.272263 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:52.272720 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:52.273532 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:52.273971 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:52.419826 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:52.428659 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:52.430376 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:52.431731 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-30f265dd-3660-44bc-ac1e-3e1dce29b3c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.171248 May 19 16:49:52.441618 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 352/693] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:52 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:52.579527 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-5af47df5-35fc-4c84-8ba4-fb4e1f1cd107 req-a42b9210-9314-4915-bbc1-910e8cdbd7a0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09c9e04-1f06-49a6-bc87-f6f5f19d6606", "tag": "a0aa27fe-54ef-4579-9ec6-c689af6a343c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:52.606564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5af47df5-35fc-4c84-8ba4-fb4e1f1cd107 req-a42b9210-9314-4915-bbc1-910e8cdbd7a0 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:52.607131 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-5af47df5-35fc-4c84-8ba4-fb4e1f1cd107 req-a42b9210-9314-4915-bbc1-910e8cdbd7a0 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:52.626511 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-5af47df5-35fc-4c84-8ba4-fb4e1f1cd107 req-a42b9210-9314-4915-bbc1-910e8cdbd7a0 service nova] Creating event network-changed:a0aa27fe-54ef-4579-9ec6-c689af6a343c for instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 on hv-cinder-84243 May 19 16:49:52.631852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-5af47df5-35fc-4c84-8ba4-fb4e1f1cd107 req-a42b9210-9314-4915-bbc1-910e8cdbd7a0 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056607 May 19 16:49:52.633385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 342/694] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:49:53.450083 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:53.450695 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:53.457135 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:53.457612 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:53.458374 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:53.458810 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:53.587296 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:53.595460 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:53.596983 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:53.598130 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2c61e32f-ca23-4cc9-84c3-5f8b0b95f884 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.152701 May 19 16:49:53.598683 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 353/695] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:53 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:49:54.616145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:54.616840 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:54.624250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:54.624703 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:54.625496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:54.625937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:54.628595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:49:54.760726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:54.768739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:54.771175 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:54.771386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6551a057-c79f-4e18-9998-7a30963ea28d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.159472 May 19 16:49:54.772087 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 343/696] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:54 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:55.789132 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:55.789792 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:55.796352 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:55.796798 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:55.797607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:55.798040 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:55.933535 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:55.941600 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:55.943132 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:55.944256 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-6f7326aa-f07d-4dd0-a636-496ad0b3e8e9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.159099 May 19 16:49:55.944821 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 354/697] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:55 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:56.962371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:56.963458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:56.969862 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:56.970305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:56.971055 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:56.971487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:57.105560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:57.113474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:57.114989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:57.116218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-92eebb31-1cf3-431e-ad44-6c35b110def6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.157829 May 19 16:49:57.116785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 344/698] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:56 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:57.636979 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:57.637576 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:57.643491 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:57.643939 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:57.644693 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:57.645125 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:57.724099 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lazy-loading 'services' on Instance uuid ec996e03-c5eb-44e0-ad6c-cbe782fd443d {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:49:57.795533 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-264aa634-4600-4d7e-a9fe-e9473466ff38 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-volume_attachments/f19507a1-b6bd-4346-820a-e9be2eab25cc" status: 202 len: 0 microversion: 2.1 time: 0.259848 May 19 16:49:57.796530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 355/699] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:49:57 2022] DELETE /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-volume_attachments/f19507a1-b6bd-4346-820a-e9be2eab25cc => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:49:58.134221 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:58.134825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:58.141280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:58.141725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:58.142486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:58.142918 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:58.273076 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:58.280965 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:58.282481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:58.283568 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5b66edde-8e63-4b14-a6b2-97707cb9eb7b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.153523 May 19 16:49:58.284116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 345/700] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:58 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:58.908724 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-3b3a423e-6b34-4408-a6ba-4968cfa94b4b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:58.915873 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b3a423e-6b34-4408-a6ba-4968cfa94b4b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:58.916328 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-3b3a423e-6b34-4408-a6ba-4968cfa94b4b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:58.976828 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-3b3a423e-6b34-4408-a6ba-4968cfa94b4b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Going to try to stop instance {{(pid=124123) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 19 16:49:59.020197 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-3b3a423e-6b34-4408-a6ba-4968cfa94b4b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action" status: 202 len: 0 microversion: 2.1 time: 0.115492 May 19 16:49:59.020797 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 356/701] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:49:58 2022] POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action => generated 0 bytes in 117 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:49:59.029264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:59.029873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:59.035917 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:59.036338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:59.037176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:59.037603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:59.169363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:59.176858 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-855d1a63-543f-4cec-bc7c-129c70ae3a1c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.151336 May 19 16:49:59.177451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 346/702] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:49:59 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:49:59.302225 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:49:59.302939 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:49:59.309624 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:59.310058 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:59.310823 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:59.311239 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:59.445780 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:59.453753 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:59.455268 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:49:59.456387 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-638e9b72-cecf-445b-a7aa-18744306f40a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.158463 May 19 16:49:59.456944 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 357/703] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:49:59 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:49:59.919090 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-4ffa75fc-e398-4d0f-904b-4b2c0a66e0ee req-2c249fe3-46f5-4fc4-8e45-b85a3b441430 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09c9e04-1f06-49a6-bc87-f6f5f19d6606", "name": "network-vif-plugged", "status": "completed", "tag": "a0aa27fe-54ef-4579-9ec6-c689af6a343c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:49:59.928079 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-4ffa75fc-e398-4d0f-904b-4b2c0a66e0ee req-2c249fe3-46f5-4fc4-8e45-b85a3b441430 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:49:59.928629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-4ffa75fc-e398-4d0f-904b-4b2c0a66e0ee req-2c249fe3-46f5-4fc4-8e45-b85a3b441430 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:49:59.941939 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-4ffa75fc-e398-4d0f-904b-4b2c0a66e0ee req-2c249fe3-46f5-4fc4-8e45-b85a3b441430 service nova] Creating event network-vif-plugged:a0aa27fe-54ef-4579-9ec6-c689af6a343c for instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 on hv-cinder-84243 May 19 16:49:59.946680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-4ffa75fc-e398-4d0f-904b-4b2c0a66e0ee req-2c249fe3-46f5-4fc4-8e45-b85a3b441430 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031989 May 19 16:49:59.947322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 347/704] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:49:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:50:00.193360 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:00.193976 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:00.196345 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell0:SELECT=6 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:00.202759 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:00.203213 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:00.203976 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:00.204414 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:00.335569 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:00.343382 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b0452d94-3776-4ae8-97a8-31f91f5d8bd4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.153837 May 19 16:50:00.343965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 358/705] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:00 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:00.471936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:00.472717 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=6 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:00.477572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:00.478262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:00.486090 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:00.486549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:00.487309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:00.487741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:00.623040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:00.633264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:00.634827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:00.635876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d6b6334b-b69f-4d86-a091-3c3502ae3cac tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.164894 May 19 16:50:00.636426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 348/706] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:50:00 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:50:01.361416 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:01.361954 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:01.368535 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:01.368995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:01.369787 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:01.370220 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:01.498995 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:01.506599 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c74ab579-e46b-452b-83e9-f269274999b2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.149159 May 19 16:50:01.507212 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 359/707] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:01 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:01.654879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:01.655490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:01.662375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:01.662827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:01.663596 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:01.664031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:01.810786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:01.818947 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:01.820460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:01.821588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a5dae2d0-494b-48ce-9b4e-11fd4b6ab062 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1406 microversion: 2.20 time: 0.171555 May 19 16:50:01.822150 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 349/708] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:50:01 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1406 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:50:02.524282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:02.524883 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:02.531993 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:02.532444 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:02.533235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:02.533673 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:02.662601 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:02.670481 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-623970b7-da4d-4880-b696-ae3a41ea208c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.149915 May 19 16:50:02.671056 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 360/709] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:02 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:02.839245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:02.839793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:02.846330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:02.846787 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:02.847556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:02.847999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:02.979628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:02.987558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:02.989057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:02.990253 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-acfd8622-41fc-463e-a923-593e5e1f45f3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1598 microversion: 2.20 time: 0.154987 May 19 16:50:02.990803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 350/710] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:50:02 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1598 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:50:03.008347 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-22c6435e-8684-4a28-9936-d90b446d755e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:03.008845 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-22c6435e-8684-4a28-9936-d90b446d755e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:03.015501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22c6435e-8684-4a28-9936-d90b446d755e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:03.015953 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22c6435e-8684-4a28-9936-d90b446d755e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:03.016716 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22c6435e-8684-4a28-9936-d90b446d755e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:03.017174 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-22c6435e-8684-4a28-9936-d90b446d755e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:03.095350 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-22c6435e-8684-4a28-9936-d90b446d755e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.091096 May 19 16:50:03.095955 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 361/711] 10.222.0.36 () {60 vars in 1315 bytes} [Thu May 19 16:50:03 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-interface => generated 285 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:50:03.687849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:03.688467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:03.694481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:03.694942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:03.695753 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:03.696204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:04.136337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:04.144139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-381d597e-1317-4e09-afde-2a686ffc6f0a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.460125 May 19 16:50:04.144640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 351/712] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:03 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:04.306980 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-05fd291f-2fac-479b-9ef3-51202ca0378f req-8d63c7bd-e671-4341-8e1f-19f905626c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b09c9e04-1f06-49a6-bc87-f6f5f19d6606", "tag": "a0aa27fe-54ef-4579-9ec6-c689af6a343c"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:50:04.315715 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-05fd291f-2fac-479b-9ef3-51202ca0378f req-8d63c7bd-e671-4341-8e1f-19f905626c7b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:04.316161 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-05fd291f-2fac-479b-9ef3-51202ca0378f req-8d63c7bd-e671-4341-8e1f-19f905626c7b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:04.329652 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-05fd291f-2fac-479b-9ef3-51202ca0378f req-8d63c7bd-e671-4341-8e1f-19f905626c7b service nova] Creating event network-changed:a0aa27fe-54ef-4579-9ec6-c689af6a343c for instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 on hv-cinder-84243 May 19 16:50:04.334663 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-05fd291f-2fac-479b-9ef3-51202ca0378f req-8d63c7bd-e671-4341-8e1f-19f905626c7b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031884 May 19 16:50:04.335435 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 362/713] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:50:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:50:05.160325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:05.160958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:05.168190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:05.168638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:05.169459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:05.169892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:05.300786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:05.309015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d67b4371-9c06-4679-ae74-37c769bd9a6b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.152495 May 19 16:50:05.309641 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 352/714] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:05 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:06.327244 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:06.327942 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:06.334339 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:06.334790 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:06.335546 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:06.335978 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:06.471545 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:06.479103 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-84bcb1f6-7b61-4387-a60e-f47e964d1ae0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.156623 May 19 16:50:06.480186 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 363/715] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:06 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:07.498366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:07.498997 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:07.505440 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:07.505896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:07.506660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:07.507098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:07.637563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:07.644993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dd1cf9a2-8a29-4e16-a04e-e7a80f6acc1d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.150825 May 19 16:50:07.645592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 353/716] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:07 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:08.663148 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:08.664234 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:08.670799 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:08.671250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:08.672021 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:08.672463 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:08.810853 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:08.818386 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8d607aeb-32ee-419d-a1ba-f102e4db8d2e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.159225 May 19 16:50:08.818942 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 364/717] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:08 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:09.835454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:09.836051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:09.842675 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:09.843136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:09.843908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:09.844348 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:10.020004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:10.027494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-86113ea4-c3eb-4797-a07d-0511f17aee39 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.195905 May 19 16:50:10.028060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 354/718] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:09 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:11.043833 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:11.044444 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:11.051024 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:11.051466 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:11.052217 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:11.052648 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:11.179503 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:11.187384 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b4a362d4-57c0-4028-b5b6-42d8d6192d8a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.147515 May 19 16:50:11.187941 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 365/719] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:11 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:50:12.204989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:12.205564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:12.212069 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:12.212519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:12.213297 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:12.213739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:12.341574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:12.348973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-323d5bde-b9bc-47ae-adbb-afe777b5c33d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.147906 May 19 16:50:12.349569 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 355/720] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:12 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:12.919311 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4da0372a-e1cd-4d47-8ef6-21e951028e0b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:50:12.920190 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4da0372a-e1cd-4d47-8ef6-21e951028e0b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:12.926886 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4da0372a-e1cd-4d47-8ef6-21e951028e0b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:12.927331 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4da0372a-e1cd-4d47-8ef6-21e951028e0b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:12.928089 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4da0372a-e1cd-4d47-8ef6-21e951028e0b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:12.928519 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4da0372a-e1cd-4d47-8ef6-21e951028e0b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:12.961310 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:13.001553 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4da0372a-e1cd-4d47-8ef6-21e951028e0b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/action" status: 202 len: 0 microversion: 2.1 time: 0.086571 May 19 16:50:13.002245 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 366/721] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:50:12 2022] POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/action => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:50:13.010116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:13.010728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:13.016916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:13.017285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:13.018052 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:13.018484 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:13.254922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:13.262879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0cc48309-a22a-4e36-bd1f-37ce5fa63a01 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1752 microversion: 2.1 time: 0.256475 May 19 16:50:13.263658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 356/722] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:13 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1752 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:13.366855 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:13.367568 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:13.374096 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:13.374548 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:13.375320 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:13.375758 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:13.509728 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:13.517310 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-2e62b817-deb6-475f-9305-c5c198900ec4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1676 microversion: 2.1 time: 0.154738 May 19 16:50:13.517888 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 367/723] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:13 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1676 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:14.279931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:14.280471 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:14.287265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:14.287720 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:14.288488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:14.288928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:14.437742 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:14.445792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0b9f33a8-ce70-4611-855f-5dfbdc13eab8 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.169733 May 19 16:50:14.446362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 357/724] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:14 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:14.534886 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:14.535419 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:14.541980 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:14.542424 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:14.543693 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:14.544126 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:14.678290 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:14.686893 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d5f2e8b0-b0d5-428a-a69d-77980a955ba9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1653 microversion: 2.1 time: 0.156013 May 19 16:50:14.687456 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 368/725] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:14 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1653 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:14.703139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-435c0e62-428f-4ba0-bbb3-19f59c8cd1bf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:50:14.709365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-435c0e62-428f-4ba0-bbb3-19f59c8cd1bf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:14.709825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-435c0e62-428f-4ba0-bbb3-19f59c8cd1bf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:14.731862 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-435c0e62-428f-4ba0-bbb3-19f59c8cd1bf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Going to try to start instance {{(pid=124122) start /opt/stack/nova/nova/compute/api.py:2730}} May 19 16:50:14.775330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-435c0e62-428f-4ba0-bbb3-19f59c8cd1bf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action" status: 202 len: 0 microversion: 2.1 time: 0.075898 May 19 16:50:14.775928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 358/726] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:50:14 2022] POST /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:50:14.786544 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:14.787105 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:14.793927 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:14.794432 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:14.795196 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:14.795613 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:14.932532 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:14.940264 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5e8789b8-46fa-4b82-86eb-7744bc732420 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1662 microversion: 2.1 time: 0.159396 May 19 16:50:14.940800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 369/727] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:14 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1662 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:15.463565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:15.464294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:15.471658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:15.472116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:15.472888 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:15.473360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:15.487962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:15.623948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:15.631891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a7616ee0-47f6-499c-b724-beb1c39d4292 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.172629 May 19 16:50:15.632464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 359/728] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:15 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:15.957637 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:15.958247 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:15.964637 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:15.965128 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:15.965902 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:15.966330 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:16.102817 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:16.110965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-d2fb7c92-88dc-424b-8765-ae43c6dfd644 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1662 microversion: 2.1 time: 0.157158 May 19 16:50:16.111650 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 370/729] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:15 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1662 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:16.649485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:16.650099 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:16.657289 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:16.657740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:16.658502 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:16.659047 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:16.799267 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:16.807294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fa9293ed-8b69-43f3-afb1-92ec9d741af1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.161796 May 19 16:50:16.807872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 360/730] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:16 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:17.128159 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:17.128775 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:17.135569 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:17.136022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:17.136818 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:17.137300 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:17.266022 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:17.273732 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e8f3238b-7404-413c-8751-71b79b374bf7 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1666 microversion: 2.1 time: 0.149507 May 19 16:50:17.274294 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 371/731] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:17 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1666 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:17.824657 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:17.825305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:17.831896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:17.832344 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:17.833102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:17.833556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:17.975576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:17.983626 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d4faa2d0-379b-4cfe-88eb-80ab801f5178 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.163468 May 19 16:50:17.984195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 361/732] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:17 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:19.001043 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:19.001606 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:19.008076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:19.008528 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:19.009326 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:19.009762 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:19.149404 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:19.157991 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-370227cb-3703-4085-a86e-7f1c2bbf8bc2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.161145 May 19 16:50:19.158558 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 372/733] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:18 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:20.175540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:20.176085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:20.177943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=55,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:20.183021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:20.183992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:20.184747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:20.185201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:20.328497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:20.336598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-605e8fc5-5ab0-4c2c-b365-3a08413690c9 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.165572 May 19 16:50:20.337180 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 362/734] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:20 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:50:21.354078 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:21.354689 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:21.360851 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:21.361335 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:21.362094 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:21.362529 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:21.505783 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:21.514309 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4bcdff64-b444-4950-b0f7-83dcf33caa3b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.164286 May 19 16:50:21.514878 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 373/735] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:21 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:22.531925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:22.532540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:22.539199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:22.539647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:22.540412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:22.540842 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:22.682262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:22.690306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-532ee36b-93a1-4ac2-bd9f-8ef662c1d3d1 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.162379 May 19 16:50:22.690876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 363/736] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:22 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:23.707794 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:23.708440 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:23.710940 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=44 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:23.716045 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:23.716499 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:23.717284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:23.717723 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:23.861086 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:23.869023 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c6892221-783f-4416-9333-e754ff1313eb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1757 microversion: 2.1 time: 0.165141 May 19 16:50:23.869612 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 374/737] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:23 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1757 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:24.886500 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:24.887738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:24.894789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:24.895246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:24.896032 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:24.896469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:25.043195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:25.051330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ee927cbb-ea3d-4110-818b-b7663c3911bb tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1760 microversion: 2.1 time: 0.168813 May 19 16:50:25.052026 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 364/738] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:24 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1760 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:25.922100 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:25.922615 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:25.929478 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:25.929930 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:25.930701 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:25.931162 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:26.010703 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lazy-loading 'services' on Instance uuid deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:50:26.081985 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cf9d1aaa-e18a-484e-87b5-200b53a80e1d tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments/bf404241-ba86-419f-8f0a-962f86c3d36e" status: 202 len: 0 microversion: 2.1 time: 0.163668 May 19 16:50:26.082633 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 375/739] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:50:25 2022] DELETE /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments/bf404241-ba86-419f-8f0a-962f86c3d36e => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:50:26.091067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c754d984-cb8c-4f74-9281-1e2dc81cb186 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:26.092052 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c754d984-cb8c-4f74-9281-1e2dc81cb186 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:26.098699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c754d984-cb8c-4f74-9281-1e2dc81cb186 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:26.099164 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c754d984-cb8c-4f74-9281-1e2dc81cb186 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:26.100141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c754d984-cb8c-4f74-9281-1e2dc81cb186 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:26.100421 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c754d984-cb8c-4f74-9281-1e2dc81cb186 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:26.131863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c754d984-cb8c-4f74-9281-1e2dc81cb186 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044532 May 19 16:50:26.132202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 365/740] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:50:26 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:50:27.144770 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-cf669aa1-aec1-4974-bc04-daa3865b118a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:27.145894 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-cf669aa1-aec1-4974-bc04-daa3865b118a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:27.153800 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf669aa1-aec1-4974-bc04-daa3865b118a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:27.154256 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf669aa1-aec1-4974-bc04-daa3865b118a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:27.155018 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf669aa1-aec1-4974-bc04-daa3865b118a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:27.155458 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-cf669aa1-aec1-4974-bc04-daa3865b118a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:27.184408 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-cf669aa1-aec1-4974-bc04-daa3865b118a tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044447 May 19 16:50:27.184956 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 376/741] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:50:27 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 16:50:27.264666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:27.265255 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:27.271806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:27.272260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:27.273020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:27.273483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:27.298426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:50:27.370845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7c0dc996-615b-4de8-a702-ddf391309db6 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 204 len: 0 microversion: 2.1 time: 0.109838 May 19 16:50:27.371097 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 366/742] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:50:27 2022] DELETE /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:50:27.379432 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:27.380052 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:27.386067 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:27.387019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:27.387785 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:27.388225 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:27.536875 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:27.544431 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-5dee7f00-6ff3-4c16-9044-8d1827c0a0ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1690 microversion: 2.1 time: 0.168930 May 19 16:50:27.545244 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 377/743] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:27 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1690 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:28.562218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:28.562836 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:28.569328 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:28.569782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:28.570548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:28.570977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:28.699904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:28.707545 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-31813554-2c11-46d0-8599-fc381b4ed2fa tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1690 microversion: 2.1 time: 0.149736 May 19 16:50:28.708107 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 367/744] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:28 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:29.725376 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:29.725971 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:29.733034 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:29.733503 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:29.734254 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:29.734685 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:29.863663 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:29.871260 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-aeaf9820-f5f7-4a2f-a6f6-452fb00b5e07 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1690 microversion: 2.1 time: 0.149773 May 19 16:50:29.872104 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 378/745] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:29 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1690 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:30.889049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:30.889766 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:30.896649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:30.897103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:30.897908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:30.898343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:31.071616 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:31.079245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5300887c-97c4-4de0-87e3-efef864bfb51 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1690 microversion: 2.1 time: 0.194682 May 19 16:50:31.079810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 368/746] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:30 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1690 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:32.055704 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-30ca7a9f-b698-415c-912c-487b321e1723 req-8f27e178-399f-4ac8-aa3b-c62c634616c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5", "name": "network-vif-deleted", "tag": "dc7ca7c9-fb4e-427b-a711-3641b6dc9306"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:50:32.065821 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-30ca7a9f-b698-415c-912c-487b321e1723 req-8f27e178-399f-4ac8-aa3b-c62c634616c2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:32.066266 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-30ca7a9f-b698-415c-912c-487b321e1723 req-8f27e178-399f-4ac8-aa3b-c62c634616c2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:32.079449 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-30ca7a9f-b698-415c-912c-487b321e1723 req-8f27e178-399f-4ac8-aa3b-c62c634616c2 service nova] Creating event network-vif-deleted:dc7ca7c9-fb4e-427b-a711-3641b6dc9306 for instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 on hv-cinder-84243 May 19 16:50:32.084965 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-30ca7a9f-b698-415c-912c-487b321e1723 req-8f27e178-399f-4ac8-aa3b-c62c634616c2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032881 May 19 16:50:32.085607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 379/747] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:50:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:50:32.095738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:32.096352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:32.103281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:32.103979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:32.104938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:32.105628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:32.175468 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:32.184767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-71c33e13-613c-42e4-9d80-0768d26dafd3 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 200 len: 1330 microversion: 2.1 time: 0.092854 May 19 16:50:32.186102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 369/748] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:32 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 1330 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:33.203197 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:33.203925 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:33.210377 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:33.210718 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:33.211491 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:33.211934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:33.226595 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] HTTP exception thrown: Instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 could not be found. May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Request method failure captured: May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 HTTP/1.1 May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOdf_UrMrp5CunZyL8epnfGmidIgSd38Jxi6Nt0UzwimlAQmRoF2t99JizNDeT69ZbhLMxKD9tr9meqBwL9LUAsjM8ValOvUnMX_KaCJO4elB1SwDEplk74cwCe_9oGe_PZCqhHwrGNQtp9CZsSp3hK-NYkgIHwPcoknV4M4zxyPB0 May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:50:33.228282 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3fbe05607bf945bbb756e7ed3764cccc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 6e88db1bf9294decaf171756772a5066 May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 could not be found. May 19 16:50:33.229860 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5'} May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 could not be found. May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:50:33.230646 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 could not be found. May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 could not be found. May 19 16:50:33.232511 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:33.234405 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Returning 404 to user: Instance deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:50:33.234405 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c3aba36d-e5d8-4f52-87f7-da63f76fd3ee tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5" status: 404 len: 111 microversion: 2.1 time: 0.031778 May 19 16:50:33.234405 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 380/749] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:33 2022] GET /compute/v2.1/servers/deedcc36-bc35-4cdb-b429-cf7e0d5ae1c5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:50:33.239360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-47a14765-ed38-4676-9a32-c40d335f4e95 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '.version_select at 0x7f489351d160>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:33.260179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-47a14765-ed38-4676-9a32-c40d335f4e95 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027727393" status: 202 len: 0 microversion: 2.1 time: 0.024589 May 19 16:50:33.261020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 370/750] 10.222.0.36 () {58 vars in 1220 bytes} [Thu May 19 16:50:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1027727393 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:50:36.113428 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:36.114027 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:36.120633 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:36.121086 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:36.122151 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:36.122591 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:36.148192 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:50:36.192658 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:36.225934 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-86ef9fb9-1096-4f32-abff-bd66d4b97728 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 204 len: 0 microversion: 2.1 time: 0.115843 May 19 16:50:36.227989 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 381/751] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:50:36 2022] DELETE /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:50:36.239096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:36.240298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:36.250851 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:36.251314 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:36.252102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:36.252550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:36.383279 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:36.391260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b42ab7fa-3ab0-4900-abf6-e057919cde33 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1507 microversion: 2.1 time: 0.159802 May 19 16:50:36.391827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 371/752] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:36 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1507 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:37.409464 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:37.410081 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:37.416607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:37.417061 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:37.417867 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:37.418940 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:37.485098 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:37.493793 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-9ae4bf78-c82d-4350-98b0-ee3a7895231e tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 200 len: 1465 microversion: 2.1 time: 0.088598 May 19 16:50:37.494579 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 382/753] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:37 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 1465 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:37.577981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-911e255e-e059-4ac6-9966-01be38defc0d req-f31893d2-c0e5-43ff-93a7-3af015c341d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f47945f2-c715-4fc2-9759-55dc7bdd02de", "name": "network-vif-deleted", "tag": "037a42bd-818d-415e-abbc-f96733de3dbd"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:50:37.589587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-911e255e-e059-4ac6-9966-01be38defc0d req-f31893d2-c0e5-43ff-93a7-3af015c341d1 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:37.591010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-911e255e-e059-4ac6-9966-01be38defc0d req-f31893d2-c0e5-43ff-93a7-3af015c341d1 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:37.606872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-911e255e-e059-4ac6-9966-01be38defc0d req-f31893d2-c0e5-43ff-93a7-3af015c341d1 service nova] Creating event network-vif-deleted:037a42bd-818d-415e-abbc-f96733de3dbd for instance f47945f2-c715-4fc2-9759-55dc7bdd02de on hv-cinder-84243 May 19 16:50:37.612635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-911e255e-e059-4ac6-9966-01be38defc0d req-f31893d2-c0e5-43ff-93a7-3af015c341d1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043841 May 19 16:50:37.613350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 372/754] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:50:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:50:38.513589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:38.513589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: f47945f2-c715-4fc2-9759-55dc7bdd02de] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:38.518924 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:38.519369 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:38.520164 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:38.520595 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:38.539163 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] HTTP exception thrown: Instance f47945f2-c715-4fc2-9759-55dc7bdd02de could not be found. May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Request method failure captured: May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de HTTP/1.1 May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOdf_UrMrp5CunZyL8epnfGmidIgSd38Jxi6Nt0UzwimlAQmRoF2t99JizNDeT69ZbhLMxKD9tr9meqBwL9LUAsjM8ValOvUnMX_KaCJO4elB1SwDEplk74cwCe_9oGe_PZCqhHwrGNQtp9CZsSp3hK-NYkgIHwPcoknV4M4zxyPB0 May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:50:38.540865 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3fbe05607bf945bbb756e7ed3764cccc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 6e88db1bf9294decaf171756772a5066 May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance f47945f2-c715-4fc2-9759-55dc7bdd02de could not be found. May 19 16:50:38.542501 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'f47945f2-c715-4fc2-9759-55dc7bdd02de'} May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f47945f2-c715-4fc2-9759-55dc7bdd02de could not be found. May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:50:38.543913 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f47945f2-c715-4fc2-9759-55dc7bdd02de could not be found. May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f47945f2-c715-4fc2-9759-55dc7bdd02de could not be found. May 19 16:50:38.545441 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:38.546773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Returning 404 to user: Instance f47945f2-c715-4fc2-9759-55dc7bdd02de could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:50:38.546773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-b5e09eab-7c18-46ef-9fa9-b1be41b0f6f8 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de" status: 404 len: 111 microversion: 2.1 time: 0.035073 May 19 16:50:38.546773 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 383/755] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:38 2022] GET /compute/v2.1/servers/f47945f2-c715-4fc2-9759-55dc7bdd02de => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:50:38.551913 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:38.552514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:38.560075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:38.560075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:38.560504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:38.560937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:38.585330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:50:38.659173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-05e11814-734f-4880-9a05-33bca72fb09c tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "DELETE /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 204 len: 0 microversion: 2.1 time: 0.111050 May 19 16:50:38.660044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 373/756] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:50:38 2022] DELETE /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 16:50:38.668093 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:38.669258 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:38.675281 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:38.675833 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:38.676486 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:38.676922 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:38.810040 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:38.817459 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-4fafa2e4-731b-4b02-9f87-71cd2fe96365 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1521 microversion: 2.1 time: 0.153165 May 19 16:50:38.818035 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 384/757] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:38 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:39.835170 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:39.836481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:39.844097 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:39.844866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:39.845673 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:39.846111 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:39.853901 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-90cd0341-577f-409f-93a9-d2cac47d2175 req-98e3107e-3cd0-42e3-b2dd-98b2882561a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e2d2c19b-7d96-4f1e-8f4a-7644b068da7f", "name": "network-vif-deleted", "tag": "73f4e6f8-050c-4f74-9343-24340265e7f1"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:50:39.867333 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-90cd0341-577f-409f-93a9-d2cac47d2175 req-98e3107e-3cd0-42e3-b2dd-98b2882561a1 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:39.868169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-90cd0341-577f-409f-93a9-d2cac47d2175 req-98e3107e-3cd0-42e3-b2dd-98b2882561a1 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:39.868294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:50:39.887028 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-90cd0341-577f-409f-93a9-d2cac47d2175 req-98e3107e-3cd0-42e3-b2dd-98b2882561a1 service nova] Creating event network-vif-deleted:73f4e6f8-050c-4f74-9343-24340265e7f1 for instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f on hv-cinder-84243 May 19 16:50:39.898637 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-90cd0341-577f-409f-93a9-d2cac47d2175 req-98e3107e-3cd0-42e3-b2dd-98b2882561a1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048344 May 19 16:50:39.899577 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 385/758] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:50:39.946561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6e88db1bf9294decaf171756772a5066', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3fbe05607bf945bbb756e7ed3764cccc', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:50:39.954577 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ddbf8a45-5455-4834-a19e-5cddb487c624 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 200 len: 1479 microversion: 2.1 time: 0.123640 May 19 16:50:39.955416 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 374/759] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:39 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 1479 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:50:40.974620 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:50:40.975320 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] [instance: e2d2c19b-7d96-4f1e-8f4a-7644b068da7f] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:50:40.982156 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:40.982606 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:40.983362 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:50:40.983792 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:50:40.997456 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] HTTP exception thrown: Instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f could not be found. May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Request method failure captured: May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f HTTP/1.1 May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOdf_UrMrp5CunZyL8epnfGmidIgSd38Jxi6Nt0UzwimlAQmRoF2t99JizNDeT69ZbhLMxKD9tr9meqBwL9LUAsjM8ValOvUnMX_KaCJO4elB1SwDEplk74cwCe_9oGe_PZCqhHwrGNQtp9CZsSp3hK-NYkgIHwPcoknV4M4zxyPB0 May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:50:40.999095 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3fbe05607bf945bbb756e7ed3764cccc", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3fbe05607bf945bbb756e7ed3764cccc"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3fbe05607bf945bbb756e7ed3764cccc May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1680359242 May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 6e88db1bf9294decaf171756772a5066 May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1680359242-project May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f could not be found. May 19 16:50:41.000602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': 'e2d2c19b-7d96-4f1e-8f4a-7644b068da7f'} May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f could not be found. May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:50:41.001589 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f could not be found. May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f could not be found. May 19 16:50:41.003073 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:50:41.004544 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] Returning 404 to user: Instance e2d2c19b-7d96-4f1e-8f4a-7644b068da7f could not be found. {{(pid=124123) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:50:41.004544 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-e21d8cc2-15bc-4000-8843-9e19eead8ad7 tempest-ServerRescueNegativeTestJSON-1680359242 tempest-ServerRescueNegativeTestJSON-1680359242-project] 10.222.0.36 "GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f" status: 404 len: 111 microversion: 2.1 time: 0.031691 May 19 16:50:41.004544 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 386/760] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:50:40 2022] GET /compute/v2.1/servers/e2d2c19b-7d96-4f1e-8f4a-7644b068da7f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:51:04.583492 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c718618d-fe11-453d-8cad-fab18b2470ad tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:04.584105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c718618d-fe11-453d-8cad-fab18b2470ad tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:04.586073 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=36,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:04.586809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:04.592687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c718618d-fe11-453d-8cad-fab18b2470ad tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:04.593134 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c718618d-fe11-453d-8cad-fab18b2470ad tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:04.594450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c718618d-fe11-453d-8cad-fab18b2470ad tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:04.594887 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c718618d-fe11-453d-8cad-fab18b2470ad tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:04.619840 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c718618d-fe11-453d-8cad-fab18b2470ad tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/ips" status: 200 len: 149 microversion: 2.1 time: 0.040316 May 19 16:51:04.620467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 375/761] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:51:04 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:05.946927 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-ea815fd9-afb1-4c01-9f23-220dc56fbb6e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc3716f7-5966-466a-86ab-a647115792b9"}} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:05.948018 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-ea815fd9-afb1-4c01-9f23-220dc56fbb6e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:05.950636 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:05.951268 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG dbcounter [-] [124123] Writing DB stats nova_cell1:SELECT=20,nova_cell1:INSERT=1 {{(pid=124123) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:05.958103 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea815fd9-afb1-4c01-9f23-220dc56fbb6e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:05.958578 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea815fd9-afb1-4c01-9f23-220dc56fbb6e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:05.959447 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea815fd9-afb1-4c01-9f23-220dc56fbb6e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:05.959794 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-ea815fd9-afb1-4c01-9f23-220dc56fbb6e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:06.223266 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-ea815fd9-afb1-4c01-9f23-220dc56fbb6e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.280070 May 19 16:51:06.224063 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 387/762] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:51:05 2022] POST /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments => generated 194 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:13.755156 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bc3716f7-5966-466a-86ab-a647115792b9"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:13.756254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:13.762955 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:13.763408 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:13.764183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:13.764621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:13.846117 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Invalid volume: volume bc3716f7-5966-466a-86ab-a647115792b9 is already attached to instances: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments HTTP/1.1 May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 74 May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:51:13.847843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {"volumeAttachment": {"volumeId": "bc3716f7-5966-466a-86ab-a647115792b9"}} May 19 16:51:13.849413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Invalid volume: volume bc3716f7-5966-466a-86ab-a647115792b9 is already attached to instances: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'server_id': '5b9cc1c6-d6f1-41fb-b66f-cc33947583d6', 'body': {'volumeAttachment': {'volumeId': 'bc3716f7-5966-466a-86ab-a647115792b9'}}} May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume bc3716f7-5966-466a-86ab-a647115792b9 is already attached to instances: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:13.850300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume bc3716f7-5966-466a-86ab-a647115792b9 is already attached to instances: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:13.851688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume bc3716f7-5966-466a-86ab-a647115792b9 is already attached to instances: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 400 to user: Invalid volume: volume bc3716f7-5966-466a-86ab-a647115792b9 is already attached to instances: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2ffa6129-7b20-4b40-9c8e-05ada9358dd5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098859 May 19 16:51:13.853447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 376/763] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:51:13 2022] POST /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 16:51:13.921779 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:13.922425 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:13.930078 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:13.930597 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:13.931608 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:13.932043 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:14.018110 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lazy-loading 'services' on Instance uuid 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:51:14.100314 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-47ae23ce-7a7b-466f-82b8-0c8518d89e53 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments/bc3716f7-5966-466a-86ab-a647115792b9" status: 202 len: 0 microversion: 2.1 time: 0.183160 May 19 16:51:14.100998 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 388/764] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:51:13 2022] DELETE /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments/bc3716f7-5966-466a-86ab-a647115792b9 => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:51:14.111190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c6137662-72f9-479f-8965-18abfe4f6327 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:14.113237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c6137662-72f9-479f-8965-18abfe4f6327 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:14.121520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6137662-72f9-479f-8965-18abfe4f6327 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:14.122385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6137662-72f9-479f-8965-18abfe4f6327 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:14.123344 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6137662-72f9-479f-8965-18abfe4f6327 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:14.123906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6137662-72f9-479f-8965-18abfe4f6327 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:14.160955 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c6137662-72f9-479f-8965-18abfe4f6327 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054933 May 19 16:51:14.161590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 377/765] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:51:14 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:15.175040 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-035a3a2c-6568-4bac-ae2a-c63101edaf60 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:15.176019 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-035a3a2c-6568-4bac-ae2a-c63101edaf60 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:15.182266 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-035a3a2c-6568-4bac-ae2a-c63101edaf60 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:15.182717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-035a3a2c-6568-4bac-ae2a-c63101edaf60 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:15.183476 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-035a3a2c-6568-4bac-ae2a-c63101edaf60 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:15.183911 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-035a3a2c-6568-4bac-ae2a-c63101edaf60 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:15.212982 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-035a3a2c-6568-4bac-ae2a-c63101edaf60 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043373 May 19 16:51:15.213596 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 389/766] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:51:15 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 16:51:15.423758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:15.424244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:15.430842 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:15.431224 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:15.431979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:15.432413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:15.458110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:51:15.531015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d4ba6b88-88a2-4160-b760-8a581c24a11d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 204 len: 0 microversion: 2.1 time: 0.111413 May 19 16:51:15.531770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 378/767] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:51:15 2022] DELETE /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:51:15.541371 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:15.541988 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:15.548500 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:15.548956 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:15.549746 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:15.550184 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:15.682702 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:15.692039 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-74f1dad4-739e-4d8e-a4f4-1c4a0c9f6197 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1681 microversion: 2.1 time: 0.154126 May 19 16:51:15.692235 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 390/768] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:15 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:16.708850 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:16.709583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:16.715999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:16.716449 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:16.717237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:16.717700 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:16.854006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:16.861460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a92ee618-5d33-415e-a37a-215543f6b5e7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1681 microversion: 2.1 time: 0.157333 May 19 16:51:16.862524 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 379/769] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:16 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:17.879694 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:17.880278 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:17.886996 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:17.887444 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:17.888214 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:17.888647 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:18.018702 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:18.026228 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-8a2d569d-ce80-4c0a-9b7c-0a13fa6f9a13 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1681 microversion: 2.1 time: 0.151068 May 19 16:51:18.026819 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 391/770] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:17 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1681 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:19.043444 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:19.044061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:19.051202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:19.051657 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:19.052456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:19.052904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:19.185034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:19.192475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-527d6b23-0f23-43f2-899b-1bc81b64a1ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1681 microversion: 2.1 time: 0.152943 May 19 16:51:19.193068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 380/771] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:19 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1681 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:20.209748 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:20.210273 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:20.216687 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:20.217138 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:20.217956 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:20.218391 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:20.352219 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:20.359713 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-a28edbc0-bf70-48cf-80df-55a61eee55ae tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1681 microversion: 2.1 time: 0.153935 May 19 16:51:20.360284 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 392/772] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:20 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:21.378010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:21.378651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:21.385071 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:21.385554 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:21.386325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:21.386761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:21.631942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:21.639770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2c219c6b-76d1-4b18-b3f9-24acadce05e9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1681 microversion: 2.1 time: 0.266178 May 19 16:51:21.640355 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 381/773] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:21 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1681 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:22.068492 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [req-c8b138f0-9644-4242-a9ce-ada7b7cf952d req-e700a851-4d26-43bd-a06d-15f39e582d9f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5b9cc1c6-d6f1-41fb-b66f-cc33947583d6", "name": "network-vif-deleted", "tag": "43573c61-29c1-4b6b-bc49-e94f505da8b8"}]} {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:22.078355 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c8b138f0-9644-4242-a9ce-ada7b7cf952d req-e700a851-4d26-43bd-a06d-15f39e582d9f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:22.078795 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [req-c8b138f0-9644-4242-a9ce-ada7b7cf952d req-e700a851-4d26-43bd-a06d-15f39e582d9f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:22.089933 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.compute.server_external_events [req-c8b138f0-9644-4242-a9ce-ada7b7cf952d req-e700a851-4d26-43bd-a06d-15f39e582d9f service nova] Creating event network-vif-deleted:43573c61-29c1-4b6b-bc49-e94f505da8b8 for instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 on hv-cinder-84243 May 19 16:51:22.095169 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [req-c8b138f0-9644-4242-a9ce-ada7b7cf952d req-e700a851-4d26-43bd-a06d-15f39e582d9f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030385 May 19 16:51:22.095763 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 393/774] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:22.657806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:22.658427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:22.665418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:22.665869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:22.666668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:22.667119 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:22.735005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:22.743093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fa846717-efcf-4289-94cf-02c0f25ecb68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1614 microversion: 2.1 time: 0.089947 May 19 16:51:22.743790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 382/775] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:22 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1614 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:23.761607 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:23.762305 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:23.769473 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:23.769945 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:23.770778 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:23.771218 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:23.832960 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:23.844520 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-c2494698-0290-4ece-a6ae-34c91cfe3439 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1327 microversion: 2.1 time: 0.087130 May 19 16:51:23.845076 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 394/776] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:23 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1327 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:24.862745 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:24.863397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:24.869480 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:24.869934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:24.870701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:24.871140 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:24.939451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:24.946956 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d5e094ec-9b0b-4803-8a09-e1698ecc6c25 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1327 microversion: 2.1 time: 0.088897 May 19 16:51:24.947576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 383/777] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:24 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1327 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:25.963717 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:25.964335 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:25.970964 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:25.971415 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:25.972188 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:25.972630 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.004069 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:26.004435 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.004884 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.objects.instance [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lazy-loading 'fault' on Instance uuid 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 {{(pid=124123) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:51:26.044519 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.policy [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124123) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:26.052602 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-bfebc6d4-29d3-49fc-8a94-2b5e6f0d1faf tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 200 len: 1332 microversion: 2.1 time: 0.092854 May 19 16:51:26.053180 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 395/778] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:25 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 1332 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:26.207065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f5ef378a-1707-42fe-bec2-528eb8135ece tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:26.208052 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f5ef378a-1707-42fe-bec2-528eb8135ece tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:26.217686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ef378a-1707-42fe-bec2-528eb8135ece tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:26.218145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ef378a-1707-42fe-bec2-528eb8135ece tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.218920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ef378a-1707-42fe-bec2-528eb8135ece tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:26.219352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f5ef378a-1707-42fe-bec2-528eb8135ece tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.251699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f5ef378a-1707-42fe-bec2-528eb8135ece tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048897 May 19 16:51:26.252261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 384/779] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:51:26 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 16:51:26.311097 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:26.311632 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:26.318280 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:26.318742 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.319520 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:26.319959 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.345047 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Going to try to terminate instance {{(pid=124123) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:51:26.425363 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.requestlog [None req-451df6b3-3fa5-4d5a-a112-a3dcd6f9eef9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 204 len: 0 microversion: 2.1 time: 0.117162 May 19 16:51:26.425949 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: [pid: 124123|app: 0|req: 396/780] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:51:26 2022] DELETE /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:51:26.434574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:26.435194 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:26.441260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:26.441720 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.442499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:26.442944 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:26.583235 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:26.590987 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-113231e9-92e0-43be-9cd1-40b3838ea928 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1672 microversion: 2.1 time: 0.160274 May 19 16:51:26.591568 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 385/781] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:26 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:27.070836 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:27.071533 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.compute.api [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124123) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:27.078027 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:27.078472 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:27.079231 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:27.079664 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG oslo_concurrency.lockutils [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124123) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:27.093530 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: INFO nova.api.openstack.wsgi [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: DEBUG nova.api.openstack.wsgi [None req-59d5e720-2c52-4ecf-9bed-c6e9cd2c6087 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: request: GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 HTTP/1.1 May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept: application/json May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Accept-Encoding: identity May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Connection: close May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Length: 0 May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Content-Type: application/json May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Host: 10.222.0.36 May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Openstack-System-Scope: None May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: User-Agent: python-urllib3/1.26.9 May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Id: None May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Domain-Name: None May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Identity-Status: Confirmed May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Is-Admin-Project: True May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Id: default May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Domain-Name: Default May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Role: reader,member May 19 16:51:27.095575 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Roles: reader,member May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Id: default May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Domain-Name: Default May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: method: > May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: exception: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:51:27.097084 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: action_args: {'id': '5b9cc1c6-d6f1-41fb-b66f-cc33947583d6'} May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: {{(pid=124123) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:51:27.098016 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:51:27.099442 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: ERROR nova.api.openstack.wsgi May 19 16:51:27.103138 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: Traceback (most recent call last): May 19 16:51:27.103250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/hub.py", line 476, in fire_timers May 19 16:51:27.103250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: timer() May 19 16:51:27.103250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: File "/usr/local/lib/python3.8/dist-packages/eventlet/hubs/timer.py", line 59, in __call__ May 19 16:51:27.103250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: cb(*args, **kw) May 19 16:51:27.103250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: File "/usr/local/lib/python3.8/dist-packages/eventlet/semaphore.py", line 147, in _do_acquire May 19 16:51:27.103250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: waiter.switch() May 19 16:51:27.103250 dv-cinder-842433-1-iscsi devstack@n-api.service[124123]: greenlet.error: cannot switch to a different thread May 19 16:51:27.608417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:27.608942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:27.615938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:27.616391 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:27.617189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:27.617623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:27.764309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:27.772141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-854df297-e8cb-4e82-bbc1-324094427ff9 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1672 microversion: 2.1 time: 0.167608 May 19 16:51:27.772828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 386/782] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:27 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1672 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:28.790924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:28.791793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:28.799044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:28.800490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:28.801796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:28.802456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:28.940009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:28.956831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-784dc95f-3d8e-4278-96f0-4b82dcd198f8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 200 len: 1604 microversion: 2.1 time: 0.169748 May 19 16:51:28.957660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 387/783] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:28 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 1604 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:28.976206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-bfed0a19-ad9e-408b-b582-493a838bd69f req-9a652119-05f7-4150-87a8-ce8d89d1ed67 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec996e03-c5eb-44e0-ad6c-cbe782fd443d", "name": "network-vif-deleted", "tag": "aaa116bf-f964-4274-a879-27bf6f601715"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:29.001908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-bfed0a19-ad9e-408b-b582-493a838bd69f req-9a652119-05f7-4150-87a8-ce8d89d1ed67 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:29.002467 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-bfed0a19-ad9e-408b-b582-493a838bd69f req-9a652119-05f7-4150-87a8-ce8d89d1ed67 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:29.015679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-bfed0a19-ad9e-408b-b582-493a838bd69f req-9a652119-05f7-4150-87a8-ce8d89d1ed67 service nova] Creating event network-vif-deleted:aaa116bf-f964-4274-a879-27bf6f601715 for instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d on hv-cinder-84243 May 19 16:51:29.022135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-bfed0a19-ad9e-408b-b582-493a838bd69f req-9a652119-05f7-4150-87a8-ce8d89d1ed67 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052415 May 19 16:51:29.022738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 388/784] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:29.976210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:29.976925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:29.983266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:29.983719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:29.984696 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:29.985142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:29.998890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] HTTP exception thrown: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Request method failure captured: May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d HTTP/1.1 May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnQBFwGnoVshTieTS7zwhUiAIOqTPNIinzdtV6B4zcZ6d6vxFGsqiZtN1pk-gGoPwH8is8qYvZH7r1sgRUyDuKD8MZ0LFT6m19sYVfM4t7JkqYD87RC-vgeclCndDjcP0SyzDbJZBwu0p3kJa5FVVDIR6lV3qX3z-sHnTEx68WJZK14 May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:51:30.000566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5d1150a9ed483bbd298b896bcf7f46", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-631649491 May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-631649491-project May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 4077d35bf1044be79bfaa013e13c530e May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-631649491-project May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:51:30.002183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'ec996e03-c5eb-44e0-ad6c-cbe782fd443d'} May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:51:30.003521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:51:30.004846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:30.005981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Returning 404 to user: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:51:30.005981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-49f11712-199c-47d9-a11b-8b6f2a1c332f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 404 len: 111 microversion: 2.1 time: 0.031010 May 19 16:51:30.005981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 389/785] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:29 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:51:30.011262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8f263e5e-4c6a-441c-a8e8-8e2753b13318 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '.version_select at 0x7f48934af430>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:30.032204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8f263e5e-4c6a-441c-a8e8-8e2753b13318 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-815400689" status: 202 len: 0 microversion: 2.1 time: 0.024555 May 19 16:51:30.032790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 390/786] 10.222.0.36 () {58 vars in 1217 bytes} [Thu May 19 16:51:30 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-815400689 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:51:30.677938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f2bd4140-dd4e-464d-9aae-882224b2f332 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'create', calling method: .version_select at 0x7f48934c1820>, body: {"keypair": {"name": "tempest-keypair-782937747", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOQ6hkaidZS2GbSHbffdszLb7cCGV31oxKpWl9I/iw5qn4wUm5lq1EKG95oH1hs00QwAAzESHBVdGwTnrFGFdebXD+7qh2fxEVWXdVP8735GnisUIf7cP9QZB9ltbdSbUg=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:30.693480 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f2bd4140-dd4e-464d-9aae-882224b2f332 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:51:30.698166 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f2bd4140-dd4e-464d-9aae-882224b2f332 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for user 4077d35bf1044be79bfaa013e13c530e and project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:51:30.720504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f2bd4140-dd4e-464d-9aae-882224b2f332 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.046940 May 19 16:51:30.721186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 391/787] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:51:30 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:51:32.022503 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1596306864", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d502c5b6-89c2-49f6-8ac0-adfabdff9156"}], "security_groups": [{"name": "tempest-securitygroup--13728263"}], "key_name": "tempest-keypair-782937747", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:32.124804 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] validate_networks() for [('d502c5b6-89c2-49f6-8ac0-adfabdff9156', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:51:32.487841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:51:32.488269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:51:32.488747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:51:32.489177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:51:32.489600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:51:32.498564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:32.499014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:32.499810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:32.500251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:32.519102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:51:32.523008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Getting quotas for user 4077d35bf1044be79bfaa013e13c530e and project fd5d1150a9ed483bbd298b896bcf7f46. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:51:32.533727 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:51:32.536027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:51:32.585025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e848a04a-cf9e-470f-a1a8-4a267d09e2dc tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.567772 May 19 16:51:32.585705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 392/788] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:51:32 2022] POST /compute/v2.1/servers => generated 400 bytes in 569 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:51:32.595301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fd3d3103-3363-48d2-950e-09abff8ea0d4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:32.595949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fd3d3103-3363-48d2-950e-09abff8ea0d4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:32.658336 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fd3d3103-3363-48d2-950e-09abff8ea0d4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:32.665516 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fd3d3103-3363-48d2-950e-09abff8ea0d4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1237 microversion: 2.1 time: 0.073775 May 19 16:51:32.666324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 393/789] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:32 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1237 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:33.682785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:33.683441 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:33.690973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:33.691421 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:33.692186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:33.692628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:33.755111 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:33.762640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d7b2904c-0fcb-4096-b79a-2e455c012362 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1241 microversion: 2.1 time: 0.083661 May 19 16:51:33.763195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 394/790] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:33 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1241 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:34.780909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:34.781582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:34.783968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=71,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:34.790476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:34.791044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:34.791834 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:34.792277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:34.797008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:34.873302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:34.882389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-99ea0cbd-9278-4b71-9154-c02d9f2d6830 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1295 microversion: 2.1 time: 0.105871 May 19 16:51:34.882961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 395/791] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:34 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1295 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:35.891294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-ffee4ef5-36e3-441f-93e0-e792419c47fe req-b7442b8d-4c47-4d4c-afe1-2774783251e6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8697fd67-9bdf-4779-9916-dae8319c1a80", "tag": "282d2d85-2868-496a-a864-3ec40b6f91a3"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:35.903332 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ffee4ef5-36e3-441f-93e0-e792419c47fe req-b7442b8d-4c47-4d4c-afe1-2774783251e6 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:35.903749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ffee4ef5-36e3-441f-93e0-e792419c47fe req-b7442b8d-4c47-4d4c-afe1-2774783251e6 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:35.916137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-ffee4ef5-36e3-441f-93e0-e792419c47fe req-b7442b8d-4c47-4d4c-afe1-2774783251e6 service nova] Creating event network-changed:282d2d85-2868-496a-a864-3ec40b6f91a3 for instance 8697fd67-9bdf-4779-9916-dae8319c1a80 on hv-cinder-84243 May 19 16:51:35.923470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-ffee4ef5-36e3-441f-93e0-e792419c47fe req-b7442b8d-4c47-4d4c-afe1-2774783251e6 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036327 May 19 16:51:35.924330 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 396/792] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:35.931561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:35.932432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:35.939407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:35.939897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:35.940680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:35.941318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:36.160792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:36.177373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-76a95cd3-b9ac-4f5c-b6b6-d5c77f5cba09 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.251640 May 19 16:51:36.178249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 397/793] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:35 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:37.195179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:37.195848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:37.202835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:37.203286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:37.204075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:37.204509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:37.337615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:37.345035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9f0c6179-4e78-43ce-9a4d-a1c534f47a43 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.153649 May 19 16:51:37.345586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 398/794] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:37 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:38.363003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:38.363698 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:38.370627 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:38.371068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:38.372133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:38.372569 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:38.506341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:38.514531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ef17159b-d0fd-4a02-a173-d9abf7c7d3a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.156089 May 19 16:51:38.515181 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 399/795] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:38 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:39.530838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:39.531447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:39.538809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:39.539263 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:39.540024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:39.540475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:39.675034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:39.684070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ea504d72-2d92-4d7f-baeb-85bbcca9c537 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.156905 May 19 16:51:39.684655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 400/796] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:39 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:40.702281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:40.703051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:40.710579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:40.711028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:40.711934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:40.712340 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:40.952362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:40.966031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5f03713c-6652-43d7-9f05-d6359ed5838b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.267517 May 19 16:51:40.978305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 401/797] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:40 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:41.983549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:41.984835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:41.991628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:41.992325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:41.993291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:41.993903 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:42.236893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:42.248990 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-637090d6-aa4f-4dbc-9117-a64215bf55ca tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.269232 May 19 16:51:42.250372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 402/798] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:41 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:42.477799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1755844665"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:42.478727 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:42.485194 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:42.485869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:42.487428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:42.488025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:42.510352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:42.663108 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=12 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:42.743926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.network.security_group_api [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Removing security group 2c4ed90d-88ea-4f0a-9187-1fc4ed2ea1b6 from port c605e454-163b-4c14-a9ba-3e1b4b3ddc8a May 19 16:51:43.781894 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-35450a8c-78c9-49a7-95b8-fdf3f2259563 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/action" status: 202 len: 0 microversion: 2.1 time: 1.308049 May 19 16:51:43.783850 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 403/799] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:51:42 2022] POST /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/action => generated 0 bytes in 1311 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:51:43.799479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:43.807033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:43.825350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:43.828567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:43.833265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:43.833869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:44.167045 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:44.178172 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d7e0ba14-5fd3-4f3a-8c8b-a3a345741553 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.392539 May 19 16:51:44.184696 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 404/800] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:43 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:44.189857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-3639ae31-4d5e-4c06-a8bd-dc7a600e1eed req-194a3d0a-2c5f-4410-a780-0e270c3bd57b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c98418-8020-43de-bbc8-d576ea6ef758", "tag": "c605e454-163b-4c14-a9ba-3e1b4b3ddc8a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:44.214497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3639ae31-4d5e-4c06-a8bd-dc7a600e1eed req-194a3d0a-2c5f-4410-a780-0e270c3bd57b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:44.215067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3639ae31-4d5e-4c06-a8bd-dc7a600e1eed req-194a3d0a-2c5f-4410-a780-0e270c3bd57b service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:44.244303 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-3639ae31-4d5e-4c06-a8bd-dc7a600e1eed req-194a3d0a-2c5f-4410-a780-0e270c3bd57b service nova] Creating event network-changed:c605e454-163b-4c14-a9ba-3e1b4b3ddc8a for instance c0c98418-8020-43de-bbc8-d576ea6ef758 on hv-cinder-84243 May 19 16:51:44.254089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-3639ae31-4d5e-4c06-a8bd-dc7a600e1eed req-194a3d0a-2c5f-4410-a780-0e270c3bd57b service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067690 May 19 16:51:44.259061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 405/801] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:44.551298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-e8e1280a-ee5f-4de9-a0f5-6157bf1e2bb1 req-8a9ab7c2-1ff7-43a3-89d7-dbb6f5abc406 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8697fd67-9bdf-4779-9916-dae8319c1a80", "name": "network-vif-plugged", "status": "completed", "tag": "282d2d85-2868-496a-a864-3ec40b6f91a3"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:44.574953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-e8e1280a-ee5f-4de9-a0f5-6157bf1e2bb1 req-8a9ab7c2-1ff7-43a3-89d7-dbb6f5abc406 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:44.575407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-e8e1280a-ee5f-4de9-a0f5-6157bf1e2bb1 req-8a9ab7c2-1ff7-43a3-89d7-dbb6f5abc406 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:44.590554 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-e8e1280a-ee5f-4de9-a0f5-6157bf1e2bb1 req-8a9ab7c2-1ff7-43a3-89d7-dbb6f5abc406 service nova] Creating event network-vif-plugged:282d2d85-2868-496a-a864-3ec40b6f91a3 for instance 8697fd67-9bdf-4779-9916-dae8319c1a80 on hv-cinder-84243 May 19 16:51:44.596598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-e8e1280a-ee5f-4de9-a0f5-6157bf1e2bb1 req-8a9ab7c2-1ff7-43a3-89d7-dbb6f5abc406 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052995 May 19 16:51:44.600012 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 406/802] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:45.203651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:45.205105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:45.212546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:45.213582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:45.214579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:45.215189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:45.416258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:45.429076 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-78c4231d-ab78-411e-981f-77b018e54bc3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.229964 May 19 16:51:45.440446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 407/803] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:45 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:45.660892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:45.661605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:45.673797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:45.676275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:45.677828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:45.678475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:45.791999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lazy-loading 'services' on Instance uuid c0c98418-8020-43de-bbc8-d576ea6ef758 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:51:45.918747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7beeda22-d12d-4984-b3f1-e1e525384046 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments/54852683-c27e-4661-9496-2ca4a621daa3" status: 202 len: 0 microversion: 2.1 time: 0.263035 May 19 16:51:45.923692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 408/804] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:51:45 2022] DELETE /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments/54852683-c27e-4661-9496-2ca4a621daa3 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:51:46.220563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-74a29567-c723-4be9-b1e5-e8aceef40cbc req-e02f0eda-f50c-4234-a302-069cdbdf64ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0c98418-8020-43de-bbc8-d576ea6ef758", "tag": "c605e454-163b-4c14-a9ba-3e1b4b3ddc8a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:46.234248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-74a29567-c723-4be9-b1e5-e8aceef40cbc req-e02f0eda-f50c-4234-a302-069cdbdf64ab service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:46.234938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-74a29567-c723-4be9-b1e5-e8aceef40cbc req-e02f0eda-f50c-4234-a302-069cdbdf64ab service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:46.250286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-74a29567-c723-4be9-b1e5-e8aceef40cbc req-e02f0eda-f50c-4234-a302-069cdbdf64ab service nova] Creating event network-changed:c605e454-163b-4c14-a9ba-3e1b4b3ddc8a for instance c0c98418-8020-43de-bbc8-d576ea6ef758 on hv-cinder-84243 May 19 16:51:46.256586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-74a29567-c723-4be9-b1e5-e8aceef40cbc req-e02f0eda-f50c-4234-a302-069cdbdf64ab service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.330217 May 19 16:51:46.257521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 409/805] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:46.263814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-96335c91-8d51-4d97-9be6-d81ec3a99a4c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:46.265328 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-96335c91-8d51-4d97-9be6-d81ec3a99a4c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:46.272749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96335c91-8d51-4d97-9be6-d81ec3a99a4c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:46.273254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96335c91-8d51-4d97-9be6-d81ec3a99a4c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:46.274247 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96335c91-8d51-4d97-9be6-d81ec3a99a4c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:46.274857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-96335c91-8d51-4d97-9be6-d81ec3a99a4c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:46.312818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-96335c91-8d51-4d97-9be6-d81ec3a99a4c tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053915 May 19 16:51:46.317637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 410/806] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:51:46 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:46.450594 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:46.452036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:46.466003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:46.466753 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:46.467782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:46.468383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:46.713499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:46.725480 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2d9496db-23c5-4be0-8a86-0041a6dc8d58 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1361 microversion: 2.1 time: 0.280983 May 19 16:51:46.735749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 411/807] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:46 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1361 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:46.741758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-574eeab9-1359-4da2-af11-5b8ebde66a73 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:46.742477 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-574eeab9-1359-4da2-af11-5b8ebde66a73 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:46.752910 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-574eeab9-1359-4da2-af11-5b8ebde66a73 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:46.753542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-574eeab9-1359-4da2-af11-5b8ebde66a73 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:46.754444 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-574eeab9-1359-4da2-af11-5b8ebde66a73 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:46.754908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-574eeab9-1359-4da2-af11-5b8ebde66a73 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:46.787595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-574eeab9-1359-4da2-af11-5b8ebde66a73 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/ips" status: 200 len: 151 microversion: 2.20 time: 0.050664 May 19 16:51:46.793901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 412/808] 10.222.0.36 () {60 vars in 1288 bytes} [Thu May 19 16:51:46 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/ips => generated 151 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 19 16:51:47.341656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-46fcfd69-7d95-493e-9c4b-52544b8aaa64 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:47.345722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-46fcfd69-7d95-493e-9c4b-52544b8aaa64 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:47.360692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46fcfd69-7d95-493e-9c4b-52544b8aaa64 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:47.362215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46fcfd69-7d95-493e-9c4b-52544b8aaa64 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:47.363586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46fcfd69-7d95-493e-9c4b-52544b8aaa64 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:47.365485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-46fcfd69-7d95-493e-9c4b-52544b8aaa64 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:47.420384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-46fcfd69-7d95-493e-9c4b-52544b8aaa64 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.088512 May 19 16:51:47.421574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 413/809] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:51:47 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments => generated 197 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:47.741869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:47.742488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:47.748807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:47.749296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:47.750076 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:47.750516 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:47.767077 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:47.917496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:47.930818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-82c39874-7091-4990-9f96-c78b6c7c6b73 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1547 microversion: 2.1 time: 0.192677 May 19 16:51:47.931841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 414/810] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:47 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1547 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:47.948415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b9e10d55-3a7d-4a84-b261-6b397abf637f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:47.948912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b9e10d55-3a7d-4a84-b261-6b397abf637f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:47.955793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9e10d55-3a7d-4a84-b261-6b397abf637f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:47.956174 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9e10d55-3a7d-4a84-b261-6b397abf637f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:47.957025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9e10d55-3a7d-4a84-b261-6b397abf637f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:47.957490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b9e10d55-3a7d-4a84-b261-6b397abf637f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:48.053017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b9e10d55-3a7d-4a84-b261-6b397abf637f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.108855 May 19 16:51:48.053941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 415/811] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:51:47 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-interface => generated 284 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:48.433767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-05edc2d1-5845-4c63-a6e2-7bf81b603ef2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:48.434715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-05edc2d1-5845-4c63-a6e2-7bf81b603ef2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:48.445351 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05edc2d1-5845-4c63-a6e2-7bf81b603ef2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:48.445806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05edc2d1-5845-4c63-a6e2-7bf81b603ef2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:48.448790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05edc2d1-5845-4c63-a6e2-7bf81b603ef2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:48.454736 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05edc2d1-5845-4c63-a6e2-7bf81b603ef2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:48.520790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-05edc2d1-5845-4c63-a6e2-7bf81b603ef2 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.092136 May 19 16:51:48.522740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 416/812] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:51:48 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments => generated 25 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 19 16:51:48.533249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:48.543533 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:48.567737 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:48.568412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:48.572479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:48.573270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:48.739331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] HTTP exception thrown: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 is not attached to volume 54852683-c27e-4661-9496-2ca4a621daa3 May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Request method failure captured: May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments/54852683-c27e-4661-9496-2ca4a621daa3 HTTP/1.1 May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnS6gRt7i21LoJgTleAxPlREMM-HSzXTukV-NO3J25yZ7BuZP8MLX1IMaNagzFzmSvQucOjTZLwnQ-0-n-AJ2Jjwq-FUvuzx1I462OLlFAXqCjMk9443G8TtnrR6p0qYKZMTcqghu4nq4smcKV1OmmuQ1J36yum7KWDPssQALKgilB0 May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 66c1f23fbe114e9885266a0092cca13c May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestMinimumBasicScenario-216844687 May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:51:48.742285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/66c1f23fbe114e9885266a0092cca13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66c1f23fbe114e9885266a0092cca13c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_66c1f23fbe114e9885266a0092cca13c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66c1f23fbe114e9885266a0092cca13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestMinimumBasicScenario-216844687 May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 66c1f23fbe114e9885266a0092cca13c May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestMinimumBasicScenario-216844687 May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestMinimumBasicScenario-216844687-project May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 39a11fe9bc8549639e7e13b6f490641c May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestMinimumBasicScenario-216844687-project May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:51:48.743612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 is not attached to volume 54852683-c27e-4661-9496-2ca4a621daa3 May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'server_id': 'c0c98418-8020-43de-bbc8-d576ea6ef758', 'id': '54852683-c27e-4661-9496-2ca4a621daa3'} May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 54852683-c27e-4661-9496-2ca4a621daa3. May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:51:48.744386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 is not attached to volume 54852683-c27e-4661-9496-2ca4a621daa3 May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 is not attached to volume 54852683-c27e-4661-9496-2ca4a621daa3 May 19 16:51:48.745589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:48.750004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Returning 404 to user: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 is not attached to volume 54852683-c27e-4661-9496-2ca4a621daa3 {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:51:48.751433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7632bb07-16d4-462b-b476-0a44c5ee7c5b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments/54852683-c27e-4661-9496-2ca4a621daa3" status: 404 len: 154 microversion: 2.1 time: 0.222271 May 19 16:51:48.754715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 417/813] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:51:48 2022] DELETE /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758/os-volume_attachments/54852683-c27e-4661-9496-2ca4a621daa3 => generated 154 bytes in 227 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:51:48.866808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:48.867942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:48.884825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:48.886249 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:48.894212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:48.911286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:48.957670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lazy-loading 'flavor' on Instance uuid b09c9e04-1f06-49a6-bc87-f6f5f19d6606 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:51:49.460366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aa67a356-0abe-40c4-baa9-5d7318013dfa tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/action" status: 202 len: 0 microversion: 2.20 time: 0.599408 May 19 16:51:49.463093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 418/814] 10.222.0.36 () {62 vars in 1318 bytes} [Thu May 19 16:51:48 2022] POST /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/action => generated 0 bytes in 604 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 16:51:49.479182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:49.479896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:49.493085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:49.493897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:49.494851 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:49.495450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:49.802963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:49.812124 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:49.814196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:49.815707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1f274347-cf59-4d50-a257-20a7d393f432 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.341086 May 19 16:51:49.832477 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 419/815] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:49 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:51:50.031533 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:50.032387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:50.045872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:50.046437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:50.047324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:50.055241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:50.103355 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:51:50.306311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-20164a2d-4658-4218-b1d5-409d91700f52 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "DELETE /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 204 len: 0 microversion: 2.1 time: 0.278370 May 19 16:51:50.311772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 420/816] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:51:50 2022] DELETE /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 16:51:50.320606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:50.321788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:50.345380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:50.346399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:50.348114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:50.348644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:50.547563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:50.558397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-201d1bef-a04c-4952-ad6e-642c9bac569b tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1554 microversion: 2.1 time: 0.244139 May 19 16:51:50.559402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 421/817] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:50 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1554 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:50.574360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-4c7c7f90-1a7c-414c-9faa-9fcb06f9262c req-e13b8c09-d533-4285-9194-989846aabdb1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8697fd67-9bdf-4779-9916-dae8319c1a80", "tag": "282d2d85-2868-496a-a864-3ec40b6f91a3"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:50.587641 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-4c7c7f90-1a7c-414c-9faa-9fcb06f9262c req-e13b8c09-d533-4285-9194-989846aabdb1 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:50.588904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-4c7c7f90-1a7c-414c-9faa-9fcb06f9262c req-e13b8c09-d533-4285-9194-989846aabdb1 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:50.605900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-4c7c7f90-1a7c-414c-9faa-9fcb06f9262c req-e13b8c09-d533-4285-9194-989846aabdb1 service nova] Creating event network-changed:282d2d85-2868-496a-a864-3ec40b6f91a3 for instance 8697fd67-9bdf-4779-9916-dae8319c1a80 on hv-cinder-84243 May 19 16:51:50.614250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-4c7c7f90-1a7c-414c-9faa-9fcb06f9262c req-e13b8c09-d533-4285-9194-989846aabdb1 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052707 May 19 16:51:50.619251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 422/818] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:50.840867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:50.841610 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:50.856554 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:50.857008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:50.859862 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:50.860619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:51.069141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:51.081186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:51.083133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:51.084985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-91cb017d-95a3-408f-b945-ec7cb14df8f8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.248860 May 19 16:51:51.086066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 423/819] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:50 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:51:51.576497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:51.577825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:51.610716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:51.611552 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:51.612593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:51.613291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:51.797204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:51.811096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-be2b6125-377f-4a99-99c2-f07cc6f233f4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1554 microversion: 2.1 time: 0.239043 May 19 16:51:51.814218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 424/820] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:51 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1554 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:51:52.174323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5ea0c25e-36c8-47c8-b542-f0fec8ec6422 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Action: 'create', calling method: .version_select at 0x7f4893497700>, body: {"keypair": {"name": "tempest-TestShelveInstance-752603937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO2hvyv58VICWRx9msTxp49jdWL+vOItemZlI2VHB8nkvt5jmfjdDltpOGkry/GMcHfdVSWkihGGmO3q0wI5RPZjL7ffTTMNKbVPytOIZQZDx/VC3xD8e7LukrLWwW2tfA=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:52.195190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-5ea0c25e-36c8-47c8-b542-f0fec8ec6422 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Getting quotas for project f232c172df994d3d909d7999238b1935. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:51:52.200573 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-5ea0c25e-36c8-47c8-b542-f0fec8ec6422 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Getting quotas for user 708dbabdda134292a8259982db495e1f and project f232c172df994d3d909d7999238b1935. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:51:52.228933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5ea0c25e-36c8-47c8-b542-f0fec8ec6422 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.187226 May 19 16:51:52.229744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 425/821] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:51:52 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:52.234245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:52.234946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:52.241508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:52.241968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:52.242756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:52.243196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:52.449047 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:52.459515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:52.461599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:52.462785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-66aa0f78-7ccf-41ed-a341-b37acb8209f0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.232291 May 19 16:51:52.463465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 426/822] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:52 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:51:52.831561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:52.833699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:52.845256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:52.861206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:52.862699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:52.863150 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:53.007316 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '39a11fe9bc8549639e7e13b6f490641c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '66c1f23fbe114e9885266a0092cca13c', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:53.023211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d0a037ab-8dd0-4652-9098-5fc705e5c9ec tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 200 len: 1512 microversion: 2.1 time: 0.198512 May 19 16:51:53.024149 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 427/823] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:52 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:51:53.087296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-8174afe0-9c1d-4358-a5a7-d621bae02d1c req-43a8866e-988b-498c-b447-d84f85ff07a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0c98418-8020-43de-bbc8-d576ea6ef758", "name": "network-vif-deleted", "tag": "c605e454-163b-4c14-a9ba-3e1b4b3ddc8a"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:51:53.100555 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-8174afe0-9c1d-4358-a5a7-d621bae02d1c req-43a8866e-988b-498c-b447-d84f85ff07a2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:53.101621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-8174afe0-9c1d-4358-a5a7-d621bae02d1c req-43a8866e-988b-498c-b447-d84f85ff07a2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:53.122130 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-8174afe0-9c1d-4358-a5a7-d621bae02d1c req-43a8866e-988b-498c-b447-d84f85ff07a2 service nova] Creating event network-vif-deleted:c605e454-163b-4c14-a9ba-3e1b4b3ddc8a for instance c0c98418-8020-43de-bbc8-d576ea6ef758 on hv-cinder-84243 May 19 16:51:53.135256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-8174afe0-9c1d-4358-a5a7-d621bae02d1c req-43a8866e-988b-498c-b447-d84f85ff07a2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051149 May 19 16:51:53.136385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 428/824] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:51:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:51:53.490737 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:53.491450 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:53.500538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:53.501003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:53.501989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:53.502306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:53.697614 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:53.706616 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:53.709081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:53.710113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-39e97233-7ce4-4c1c-aab7-970eca1e6d4e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.230378 May 19 16:51:53.721631 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 429/825] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:53 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:51:54.040744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:54.042202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] [instance: c0c98418-8020-43de-bbc8-d576ea6ef758] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:54.049553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:54.050462 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:54.051482 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:54.052142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:54.055265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:54.070793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] HTTP exception thrown: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 could not be found. May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Request method failure captured: May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 HTTP/1.1 May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnS6gRt7i21LoJgTleAxPlREMM-HSzXTukV-NO3J25yZ7BuZP8MLX1IMaNagzFzmSvQucOjTZLwnQ-0-n-AJ2Jjwq-FUvuzx1I462OLlFAXqCjMk9443G8TtnrR6p0qYKZMTcqghu4nq4smcKV1OmmuQ1J36yum7KWDPssQALKgilB0 May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 66c1f23fbe114e9885266a0092cca13c May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestMinimumBasicScenario-216844687 May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:51:54.072635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/66c1f23fbe114e9885266a0092cca13c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66c1f23fbe114e9885266a0092cca13c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_66c1f23fbe114e9885266a0092cca13c", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/66c1f23fbe114e9885266a0092cca13c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestMinimumBasicScenario-216844687 May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 66c1f23fbe114e9885266a0092cca13c May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestMinimumBasicScenario-216844687 May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestMinimumBasicScenario-216844687-project May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 39a11fe9bc8549639e7e13b6f490641c May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestMinimumBasicScenario-216844687-project May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 could not be found. May 19 16:51:54.074061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'c0c98418-8020-43de-bbc8-d576ea6ef758'} May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 could not be found. May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:51:54.074778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 could not be found. May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 could not be found. May 19 16:51:54.075963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:51:54.078344 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Returning 404 to user: Instance c0c98418-8020-43de-bbc8-d576ea6ef758 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:51:54.079507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ba3cb5c8-c38f-4a78-9f6e-3f9f748e06a4 tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758" status: 404 len: 111 microversion: 2.1 time: 0.042698 May 19 16:51:54.081060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 430/826] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:51:54 2022] GET /compute/v2.1/servers/c0c98418-8020-43de-bbc8-d576ea6ef758 => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:51:54.089721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-44e476c6-1858-4eea-a851-6d3623d65c0f tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] Calling method '.version_select at 0x7f4893497700>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:54.109089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-44e476c6-1858-4eea-a851-6d3623d65c0f tempest-TestMinimumBasicScenario-216844687 tempest-TestMinimumBasicScenario-216844687-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1575118185" status: 202 len: 0 microversion: 2.1 time: 0.023840 May 19 16:51:54.109749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 431/827] 10.222.0.36 () {58 vars in 1271 bytes} [Thu May 19 16:51:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1575118185 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:51:54.729908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:54.730535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:54.738033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:54.738490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:54.739273 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:54.739717 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:54.969136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:54.982782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:54.984407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:54.986151 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cf1b9822-5252-4ce0-9d4d-e2f92d023bee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.260243 May 19 16:51:54.987941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 432/828] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:54 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:51:56.006977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:56.007661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:56.014566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:56.015155 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:56.016028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:56.016760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:56.189051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:56.198902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:56.200555 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:56.201943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-47beee82-356e-4344-80c0-5d2121588158 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.200525 May 19 16:51:56.202575 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 433/829] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:56 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:51:57.220319 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:57.221042 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:57.228284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:57.228741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:57.229575 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:57.230460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:57.379008 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:57.396821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:57.398535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:57.399988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1958df09-edd2-4a89-aa71-db62e583bdec tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.183449 May 19 16:51:57.400539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 434/830] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:57 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:51:58.418643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:58.419624 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:58.430610 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:58.431316 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:58.432288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:58.433200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:58.641859 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:58.657372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:58.659268 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:51:58.660735 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2ec810a6-5570-4b0f-b5d4-70a43226b338 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.245949 May 19 16:51:58.673190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 435/831] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:58 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:51:59.679056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:51:59.679783 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:51:59.682237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:INSERT=1,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:51:59.687998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:59.688464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:51:59.689282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:51:59.690305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:00.337599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:00.346768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:00.348310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:00.349732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8485ca5b-632e-41a9-bdfe-79fae6b985d8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.674896 May 19 16:52:00.350437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 436/832] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:51:59 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:01.369338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:01.369338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:01.379551 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:01.380005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:01.380790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:01.381328 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:01.599505 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:01.613816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:01.615664 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:01.617215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-05e834b1-9748-4f46-bde8-23752db07c8d tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.252728 May 19 16:52:01.617835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 437/833] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:01 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:02.634918 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:02.635666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:02.637744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:02.645190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:02.645954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:02.647469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:02.647925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:02.838283 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:02.851413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:02.855171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:02.857371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0eb9ed52-6bd2-4b5f-acf1-d773ad628164 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.225592 May 19 16:52:02.858350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 438/834] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:02 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:03.875692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:03.876333 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:03.883006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:03.883500 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:03.884280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:03.884747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:04.023642 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:04.031637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:04.033224 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:04.034888 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-79d6b889-5232-416a-8237-483124aaaaf6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.163391 May 19 16:52:04.035435 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 439/835] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:03 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:05.053242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:05.053892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:05.060223 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:05.060667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:05.061459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:05.061892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:05.188676 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:05.197472 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:05.198991 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:05.200160 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cdf4f767-709b-4d3b-bf88-47455038d3af tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.150889 May 19 16:52:05.200710 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 440/836] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:05 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:06.219321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:06.220011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:06.226663 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:06.227118 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:06.227899 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:06.228344 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:06.363938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:06.372237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:06.373770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:06.374936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-65ea7813-e4bb-43a9-83e8-e4502c2c13d3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.159522 May 19 16:52:06.375487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 441/837] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:06 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:07.393772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:07.394414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:07.400873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:07.401363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:07.402162 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:07.402603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:07.534067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:07.542085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:07.543584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:07.544742 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8558a7b2-25ab-463b-9235-ce9eddf9f235 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.155598 May 19 16:52:07.545327 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 442/838] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:07 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:08.563519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:08.564265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:08.570734 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:08.571190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:08.571995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:08.572437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:08.702386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:08.711434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:08.712949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:08.714180 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0377c1b9-c1ae-4ae9-8bc9-2b9ac57895df tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.154620 May 19 16:52:08.714738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 443/839] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:08 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:09.731912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:09.732600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:09.739132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:09.739603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:09.740372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:09.740816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:09.873041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:09.881012 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:09.882574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:09.883735 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fe3007ec-8669-4b6a-9f99-9e8f63439dc1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.155727 May 19 16:52:09.884307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 444/840] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:09 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:10.205749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-ce2a14c7-616d-44aa-859a-9d41c9a62cf6 req-404433f7-4fab-4f6f-a077-7c6f55a2bd16 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09c9e04-1f06-49a6-bc87-f6f5f19d6606", "name": "network-vif-plugged", "status": "completed", "tag": "a0aa27fe-54ef-4579-9ec6-c689af6a343c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:10.214606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ce2a14c7-616d-44aa-859a-9d41c9a62cf6 req-404433f7-4fab-4f6f-a077-7c6f55a2bd16 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:10.214960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ce2a14c7-616d-44aa-859a-9d41c9a62cf6 req-404433f7-4fab-4f6f-a077-7c6f55a2bd16 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:10.227837 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-ce2a14c7-616d-44aa-859a-9d41c9a62cf6 req-404433f7-4fab-4f6f-a077-7c6f55a2bd16 service nova] Creating event network-vif-plugged:a0aa27fe-54ef-4579-9ec6-c689af6a343c for instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 on hv-cinder-84243 May 19 16:52:10.233232 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-ce2a14c7-616d-44aa-859a-9d41c9a62cf6 req-404433f7-4fab-4f6f-a077-7c6f55a2bd16 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031788 May 19 16:52:10.233821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 445/841] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:52:10.902674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:10.903383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:10.910831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:10.911291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:10.912071 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:10.912517 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:11.067158 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:11.075405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:11.077072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:11.078514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-740bdedf-589f-470e-9c67-97caf7486d68 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.179885 May 19 16:52:11.079789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 446/842] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:10 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:12.097301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:12.097992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:12.104557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:12.105014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:12.105828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:12.106303 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:12.243925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:12.252844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:12.254398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:12.255572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1a43b912-c94a-4ffe-afc3-9bc6153e7e64 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.162297 May 19 16:52:12.256125 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 447/843] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:12 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:13.273701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:13.274366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:13.280948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:13.281427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:13.282189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:13.282625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:13.419925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:13.427942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:13.429465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:13.430632 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-758e617d-9983-4d3e-a662-32ae68f10f40 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.160805 May 19 16:52:13.431191 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 448/844] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:13 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:14.449127 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:14.449797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:14.456830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:14.457312 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:14.458094 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:14.458535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:14.461329 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:14.590615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:14.598738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:14.600239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:14.601431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-29cbd219-c578-40fd-92e5-1f930f0be087 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1743 microversion: 2.20 time: 0.156223 May 19 16:52:14.601989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 449/845] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:14 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:15.620027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:15.620661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:15.628000 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:15.628453 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:15.629912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:15.630808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:15.788216 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:15.796493 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:15.798033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:15.799814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-75391376-1f29-4253-a9f3-aee3874792ee tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.184253 May 19 16:52:15.800379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 450/846] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:15 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:16.820100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:16.821665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:16.830628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:16.831720 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:16.832929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:16.833692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:17.014733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:17.027441 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:17.029082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:17.030407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1bfd49ba-ef17-45b0-bc98-0d8f4a87b20a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.214569 May 19 16:52:17.031078 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 451/847] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:16 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:17.453403 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1908320539", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-752603937", "security_groups": [{"name": "tempest-secgroup-smoke-1027552672"}], "networks": [{"uuid": "3469f2a0-dc3c-4426-85a2-390e0d45d3c3"}], "block_device_mapping_v2": [{"uuid": "19b0aff9-efe7-469d-9991-3d0eb2f40647", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:17.583542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] validate_networks() for [('3469f2a0-dc3c-4426-85a2-390e0d45d3c3', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:52:18.025966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:52:18.026443 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:52:18.026858 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:52:18.027275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:52:18.027692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:52:18.038269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:18.038721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:18.039521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:18.039975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:18.058740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Getting quotas for project f232c172df994d3d909d7999238b1935. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:52:18.062854 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Getting quotas for user 708dbabdda134292a8259982db495e1f and project f232c172df994d3d909d7999238b1935. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:52:18.124772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:52:18.127272 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='19b0aff9-efe7-469d-9991-3d0eb2f40647',volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:52:18.273419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f0e38d01-375b-4fa9-a563-9c2d32c1c05c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.823932 May 19 16:52:18.274556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 452/848] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:52:17 2022] POST /compute/v2.1/servers => generated 406 bytes in 825 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:52:18.279040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:18.279701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:18.287447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:18.287936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:18.288689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:18.289133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:18.437750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:18.448207 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:18.450267 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:18.451457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0696d789-f046-49c4-8f79-f81feb30f46e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.176154 May 19 16:52:18.452259 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 453/849] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:18 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:18.457081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e48d22d4-c5e6-4eae-ab79-d56c07b8b2d9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:18.457723 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e48d22d4-c5e6-4eae-ab79-d56c07b8b2d9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:18.511843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e48d22d4-c5e6-4eae-ab79-d56c07b8b2d9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:18.519229 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e48d22d4-c5e6-4eae-ab79-d56c07b8b2d9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1088 microversion: 2.1 time: 0.066205 May 19 16:52:18.519812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 454/850] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:18 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1088 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:19.472053 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:19.472703 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:19.480434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:19.480897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:19.481726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:19.482175 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:19.627010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:19.635739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:19.637293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:19.638475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-28828808-f85c-4715-aad7-b9284c8330ef tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.170931 May 19 16:52:19.639039 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 455/851] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:19 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:19.651262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d83706b4-183d-43b4-9ee1-198204b4a445 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:19.651808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d83706b4-183d-43b4-9ee1-198204b4a445 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:19.713710 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d83706b4-183d-43b4-9ee1-198204b4a445 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:19.721209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d83706b4-183d-43b4-9ee1-198204b4a445 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1088 microversion: 2.1 time: 0.080616 May 19 16:52:19.721772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 456/852] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:19 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1088 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:20.657745 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:20.658391 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:20.666294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:20.666757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:20.667549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:20.667993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:20.814177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:20.824776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:20.826394 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:20.829115 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-66bf8b8e-1282-4a8b-9151-910eedd671e6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.174443 May 19 16:52:20.829755 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 457/853] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:20 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:20.846119 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-928fa650-b5c1-4406-8166-e56cf75f8c21 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:20.847291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-928fa650-b5c1-4406-8166-e56cf75f8c21 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:20.911547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-928fa650-b5c1-4406-8166-e56cf75f8c21 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:20.918997 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-928fa650-b5c1-4406-8166-e56cf75f8c21 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1088 microversion: 2.1 time: 0.088166 May 19 16:52:20.919587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 458/854] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:20 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1088 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:21.850369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:21.851050 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:21.860704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:21.861299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:21.862055 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:21.862501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:22.016786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:22.026788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:22.029520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:22.030707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1220eab3-b7a3-4f55-ac68-83c9d9940783 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.187034 May 19 16:52:22.031262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 459/855] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:21 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:22.037337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:22.037947 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:22.044828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:22.045308 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:22.046761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:22.047525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:22.115667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:22.123879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8b4818c6-c52d-45dc-998e-c914f8920960 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1138 microversion: 2.1 time: 0.091620 May 19 16:52:22.124476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 460/856] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:22 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1138 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:23.049942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:23.050560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:23.057298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:23.057757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:23.058534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:23.058975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:23.243339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:23.254702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:23.256336 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:23.257568 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-27a8904d-0657-4d42-aba2-a9b801534bad tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.211784 May 19 16:52:23.268576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 461/857] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:23 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:23.268576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:23.268576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:23.271186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:23.271647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:23.272487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:23.272940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:23.353114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:23.362211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-583eb00b-1072-4da0-8bd1-65cd1c27ccaa tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1186 microversion: 2.1 time: 0.102978 May 19 16:52:23.363171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 462/858] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:23 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1186 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:24.277336 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:24.278669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:24.288766 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:24.289491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:24.290931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:24.292436 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:24.580846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:24.594412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:24.597061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:24.598514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c94c9765-97fa-4fad-925f-16194b27cf27 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.326208 May 19 16:52:24.609387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 463/859] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:24 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:24.615123 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:24.615971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:24.622667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:24.623121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:24.624095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:24.624536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:25.120311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:25.130105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7ba97b29-b06a-4da3-9e2e-b7552cdde0b5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.519221 May 19 16:52:25.141332 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 464/860] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:24 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 531 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:25.579188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-6de94e58-f9b8-4843-a9a9-c375241804b5 req-a3e4db5f-cd08-4720-be7b-97d48f4291af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8395bd9a-4534-4aa5-b2d0-f08d866a9339", "tag": "bdcf063e-89c5-4dd4-8d96-078d31278d21"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:25.600025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6de94e58-f9b8-4843-a9a9-c375241804b5 req-a3e4db5f-cd08-4720-be7b-97d48f4291af service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:25.601337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6de94e58-f9b8-4843-a9a9-c375241804b5 req-a3e4db5f-cd08-4720-be7b-97d48f4291af service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:25.624087 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-6de94e58-f9b8-4843-a9a9-c375241804b5 req-a3e4db5f-cd08-4720-be7b-97d48f4291af service nova] Creating event network-changed:bdcf063e-89c5-4dd4-8d96-078d31278d21 for instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 on hv-cinder-84243 May 19 16:52:25.631128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-6de94e58-f9b8-4843-a9a9-c375241804b5 req-a3e4db5f-cd08-4720-be7b-97d48f4291af service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056117 May 19 16:52:25.632333 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 465/861] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:52:25.639324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:25.640361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:25.649810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:25.650531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:25.651485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:25.652110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:25.941884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:25.951429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:25.953015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:25.954323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4e9f1c00-a972-4279-a77c-a2aab239036b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.320546 May 19 16:52:25.965812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 466/862] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:25 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:26.148573 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:26.149779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:26.156485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:26.156952 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:26.160172 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:26.162497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:26.343985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:26.353921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-59397269-74b3-4724-bdd8-0bb609265609 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.209331 May 19 16:52:26.363858 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 467/863] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:26 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:26.973178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:26.973865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:26.980766 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:26.981322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:26.982113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:26.982555 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:27.196223 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:27.204250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:27.205839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:27.207088 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c965b86e-e80d-4247-8841-9ad44be86aae tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1738 microversion: 2.20 time: 0.238330 May 19 16:52:27.207643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 468/864] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:26 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:27.211971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:27.212574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:27.218725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:27.219178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:27.219954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:27.220412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:27.234950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 HTTP/1.1 May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:52:27.237379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:52:27.239009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '5b9cc1c6-d6f1-41fb-b66f-cc33947583d6'} May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:52:27.240188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:52:27.241609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:52:27.243202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:52:27.243202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e5d58903-4b6d-4f27-8eca-40fb85475680 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 404 len: 111 microversion: 2.1 time: 0.030226 May 19 16:52:27.243202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 469/865] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:27 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:52:27.247615 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b38ea2c2-0224-4546-b8c2-5ce46da55382 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '.version_select at 0x7f48934c1dc0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:27.266650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b38ea2c2-0224-4546-b8c2-5ce46da55382 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964442468" status: 202 len: 0 microversion: 2.1 time: 0.022814 May 19 16:52:27.267248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 470/866] 10.222.0.36 () {58 vars in 1220 bytes} [Thu May 19 16:52:27 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1964442468 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:52:27.372539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:27.373832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:27.380659 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:27.381284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:27.382206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:27.382851 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:27.613827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:27.617733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:27.626352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-51611188-c0a7-4ff2-8107-9beea467efae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.258525 May 19 16:52:27.627470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 471/867] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:27 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:27.925081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-07ef08ca-6c9b-4ddf-be7c-caae477a44a6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: .version_select at 0x7f48934c10d0>, body: {"keypair": {"name": "tempest-keypair-587170352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBESRljJ9jTzP06YhizffZlAZk0Oh1cp+akhbdj+0PTuQcl9inb7+sQZMhKfaGFqfz43fnJbjxLtGUpMZYSAbhkDshyG01C6MX1sUOYPrzunaaDx5IvfO9A1J6Ef1xsPGfQ=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:27.942919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-07ef08ca-6c9b-4ddf-be7c-caae477a44a6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:52:27.944301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:27.948946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-07ef08ca-6c9b-4ddf-be7c-caae477a44a6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:52:27.978705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-07ef08ca-6c9b-4ddf-be7c-caae477a44a6 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057708 May 19 16:52:27.981302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 472/868] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:52:27 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:52:28.221958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:28.226438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:28.227058 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:28.233686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:28.234145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:28.234927 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:28.235370 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:28.472538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:28.481355 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:28.483104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:28.484427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4bd8472d-59e1-4695-8135-ecd8bf585b7a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1720 microversion: 2.20 time: 0.263249 May 19 16:52:28.485623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 473/869] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:28 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1720 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:28.644422 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:28.645087 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:28.651650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:28.652105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:28.652994 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:28.653500 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:28.802650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:28.810403 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1394d7ca-d2ad-4b19-afaf-78ddb23ff602 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.170469 May 19 16:52:28.811007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 474/870] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:28 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:29.506519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:29.507558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:29.515181 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:29.515710 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:29.516586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:29.517016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:29.657767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:29.665993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:29.667503 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:29.668671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fd896e8a-851c-40a7-8648-8c0115a0bd95 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1720 microversion: 2.20 time: 0.169002 May 19 16:52:29.669265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 475/871] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:29 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:29.674953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1462123100", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "84ed37a0-33b7-474f-8c60-1eac20f29b87"}], "security_groups": [{"name": "tempest-securitygroup--1199784614"}], "key_name": "tempest-keypair-587170352", "user_data": "}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:29.781510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] validate_networks() for [('84ed37a0-33b7-474f-8c60-1eac20f29b87', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:52:30.175880 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:52:30.176300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:52:30.176774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:52:30.177215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:52:30.177631 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:52:30.187062 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.187511 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:30.188309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.188770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:30.208583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:52:30.214405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Getting quotas for user 0695c868a2d844089fcda29ea3653d5c and project 3e200a1b99664fc8b41757e2ae404f50. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:52:30.228618 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:52:30.230921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:52:30.288988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ff8ecee8-06fc-4fc3-b500-d2c8244b5705 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.618669 May 19 16:52:30.289962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 476/872] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:52:29 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 19 16:52:30.297489 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:30.297489 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:30.303849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.304311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:30.305124 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.305595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:30.456788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:30.465346 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fbc27f55-6a53-4e42-a8c4-2be23eac8585 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.173962 May 19 16:52:30.465949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 477/873] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:30 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:30.471635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-19684383-9f5f-4a8c-9ec3-9cbff33e56de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:30.472542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-19684383-9f5f-4a8c-9ec3-9cbff33e56de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:30.531682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-19684383-9f5f-4a8c-9ec3-9cbff33e56de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:30.541397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-19684383-9f5f-4a8c-9ec3-9cbff33e56de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1241 microversion: 2.1 time: 0.073135 May 19 16:52:30.542433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 478/874] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:30 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:30.687772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:30.688466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:30.696800 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.697275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:30.698152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.698551 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:30.842940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:30.851578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:30.853094 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:30.854303 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-58b66dfa-f046-4d09-bd54-dde3fe7282e5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1663 microversion: 2.20 time: 0.171003 May 19 16:52:30.854867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 479/875] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:30 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1663 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:30.872043 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8dfee1f9-f9a1-4ccf-9f39-c81a12c9504f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3ddb017a-f4cc-4657-91bf-d20649046a12"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:30.873317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8dfee1f9-f9a1-4ccf-9f39-c81a12c9504f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:30.879908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8dfee1f9-f9a1-4ccf-9f39-c81a12c9504f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.880359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8dfee1f9-f9a1-4ccf-9f39-c81a12c9504f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:30.881135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8dfee1f9-f9a1-4ccf-9f39-c81a12c9504f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:30.881592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8dfee1f9-f9a1-4ccf-9f39-c81a12c9504f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.170938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8dfee1f9-f9a1-4ccf-9f39-c81a12c9504f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.303036 May 19 16:52:31.171580 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 480/876] 10.222.0.36 () {62 vars in 1363 bytes} [Thu May 19 16:52:30 2022] POST /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-volume_attachments => generated 188 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 19 16:52:31.298740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d144d252-589e-4173-8e98-ac2d2f117e0b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:31.299252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d144d252-589e-4173-8e98-ac2d2f117e0b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:31.315256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d144d252-589e-4173-8e98-ac2d2f117e0b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.315716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d144d252-589e-4173-8e98-ac2d2f117e0b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.316515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d144d252-589e-4173-8e98-ac2d2f117e0b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.317002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d144d252-589e-4173-8e98-ac2d2f117e0b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.590337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d144d252-589e-4173-8e98-ac2d2f117e0b tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-volume_attachments/3ddb017a-f4cc-4657-91bf-d20649046a12" status: 202 len: 0 microversion: 2.20 time: 0.297266 May 19 16:52:31.591027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 481/877] 10.222.0.36 () {60 vars in 1456 bytes} [Thu May 19 16:52:31 2022] DELETE /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-volume_attachments/3ddb017a-f4cc-4657-91bf-d20649046a12 => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 19 16:52:31.596035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:31.596649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:31.606877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.607487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.608104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.608876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.841776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:31.850791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2044deae-2c43-4e6d-8cde-9b920753cd51 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.258662 May 19 16:52:31.851821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 482/878] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:31 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:31.856571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:31.857214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:31.864788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.865259 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.871360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.871360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.943926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:31.951638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c033b343-a651-4bea-889b-cd891b4c8f62 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1299 microversion: 2.1 time: 0.098773 May 19 16:52:31.952260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 483/879] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:31 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1299 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:31.957662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7b2d7331-3965-43e0-a9d7-b0ef9a585650 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:31.958229 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7b2d7331-3965-43e0-a9d7-b0ef9a585650 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:31.964327 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b2d7331-3965-43e0-a9d7-b0ef9a585650 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.964779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b2d7331-3965-43e0-a9d7-b0ef9a585650 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:31.965576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b2d7331-3965-43e0-a9d7-b0ef9a585650 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:31.966010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b2d7331-3965-43e0-a9d7-b0ef9a585650 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:32.053161 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=85,nova_cell1:INSERT=6,nova_cell1:UPDATE=9 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:32.068201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7b2d7331-3965-43e0-a9d7-b0ef9a585650 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "POST /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/action" status: 202 len: 0 microversion: 2.20 time: 0.114896 May 19 16:52:32.071968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 484/880] 10.222.0.36 () {62 vars in 1318 bytes} [Thu May 19 16:52:31 2022] POST /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/action => generated 0 bytes in 119 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 19 16:52:32.076781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:32.077431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:32.084257 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:32.084718 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:32.085528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:32.085958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:32.297469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:32.307727 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:32.310106 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:32.311362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e55efa59-2376-45cd-a505-d892025681d0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1671 microversion: 2.20 time: 0.238312 May 19 16:52:32.312395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 485/881] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:32 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1671 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:32.432874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-71bbdf4c-67fe-40ae-9e65-e96ca3dc4c76 req-0c3d0dc0-6896-4352-a22a-d58d313a56a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09c9e04-1f06-49a6-bc87-f6f5f19d6606", "name": "network-vif-unplugged", "status": "completed", "tag": "a0aa27fe-54ef-4579-9ec6-c689af6a343c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:32.443715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-71bbdf4c-67fe-40ae-9e65-e96ca3dc4c76 req-0c3d0dc0-6896-4352-a22a-d58d313a56a5 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:32.444273 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-71bbdf4c-67fe-40ae-9e65-e96ca3dc4c76 req-0c3d0dc0-6896-4352-a22a-d58d313a56a5 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:32.456768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.compute.server_external_events [req-71bbdf4c-67fe-40ae-9e65-e96ca3dc4c76 req-0c3d0dc0-6896-4352-a22a-d58d313a56a5 service nova] Unable to find a host for instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606. Dropping event network-vif-unplugged {{(pid=124122) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 16:52:32.457847 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-71bbdf4c-67fe-40ae-9e65-e96ca3dc4c76 req-0c3d0dc0-6896-4352-a22a-d58d313a56a5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.029791 May 19 16:52:32.458729 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 486/882] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:32 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 31 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 19 16:52:32.868859 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:32.869719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:32.876705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:32.877187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:32.878515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:32.878954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:33.029567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:33.039866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e6347fa4-a63c-4429-b779-6348a7712e02 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.175759 May 19 16:52:33.040734 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 487/883] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:32 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:33.046399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:33.047017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:33.053908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:33.054366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:33.055877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:33.055877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:33.222121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:33.229912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d9dfb6ae-badc-4964-9883-7e4b5785dcef tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.187808 May 19 16:52:33.231520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 488/884] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:33 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:33.330463 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:33.331540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:33.337822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:33.338286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:33.339065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:33.339509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:33.568018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:33.576808 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:33.578368 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:33.579542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ed289619-843b-4ce3-9b57-5b68c94beab5 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1673 microversion: 2.20 time: 0.253171 May 19 16:52:33.580108 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 489/885] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:33 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1673 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:33.952106 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-8ae7bc2f-e248-4274-a4df-531b8a0b697f req-ce54ce3f-ac27-4f71-88d2-c17838627077 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd294276-db1b-4d22-a56c-4521ea0d0eac", "tag": "66429d3e-5852-4dce-a0ad-1c45010f9bbf"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:33.966876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-8ae7bc2f-e248-4274-a4df-531b8a0b697f req-ce54ce3f-ac27-4f71-88d2-c17838627077 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:33.980257 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-8ae7bc2f-e248-4274-a4df-531b8a0b697f req-ce54ce3f-ac27-4f71-88d2-c17838627077 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:33.995177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-8ae7bc2f-e248-4274-a4df-531b8a0b697f req-ce54ce3f-ac27-4f71-88d2-c17838627077 service nova] Creating event network-changed:66429d3e-5852-4dce-a0ad-1c45010f9bbf for instance fd294276-db1b-4d22-a56c-4521ea0d0eac on hv-cinder-84243 May 19 16:52:34.001839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-8ae7bc2f-e248-4274-a4df-531b8a0b697f req-ce54ce3f-ac27-4f71-88d2-c17838627077 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053545 May 19 16:52:34.003128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 490/886] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:52:34.056629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:34.057803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:34.065031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:34.065859 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:34.066843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:34.067451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:34.289845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:34.297981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3a39c20d-84d0-4521-a101-dcb4723355c8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.245765 May 19 16:52:34.309464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 491/887] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:34 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:34.309464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:34.309464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:34.311906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:34.312363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:34.313170 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:34.313623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:34.829128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:34.843999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9501f62c-e99c-49bb-8af9-760f4f6bef41 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.543144 May 19 16:52:34.861586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 492/888] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:34 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:34.867870 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:34.869063 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:34.878283 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:34.882031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:34.883114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:34.883622 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:35.056928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:35.064999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:35.067086 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:35.068277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-159e8fea-4736-41f9-a5eb-ccafc8db06d9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.205324 May 19 16:52:35.069260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 493/889] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:34 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:35.320157 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:35.321011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:35.327222 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:35.327682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:35.328460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:35.328904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:35.473845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:35.481951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6455c230-1b07-47fc-a18d-5844c567135c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.166546 May 19 16:52:35.491211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 494/890] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:35 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:35.875382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:35.875993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:35.884369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:35.884827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:35.885764 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:35.886342 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:36.033882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:36.041382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f8415fff-f07b-4bcf-a902-8fc2febac194 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.170540 May 19 16:52:36.041947 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 495/891] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:35 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:36.087236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:36.087985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:36.094883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:36.095469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:36.096559 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:36.097110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:36.255685 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:36.264761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:36.266605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:36.267779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b83910b6-79aa-4202-999e-8ae3f5502479 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.184850 May 19 16:52:36.268387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 496/892] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:36 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:36.499339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:36.500233 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:36.508112 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:36.508560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:36.509364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:36.509803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:36.652572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:36.661177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b48b3388-9b7c-46b4-893a-ce52240c3e3c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.166147 May 19 16:52:36.661954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 497/893] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:36 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:37.058747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:37.059832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:37.066533 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:37.066990 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:37.067932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:37.068374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:37.213030 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:37.222030 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dad77c70-7e39-4f94-a50c-672b957f9dba tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.166937 May 19 16:52:37.223023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 498/894] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:37 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:37.286820 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:37.287403 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:37.294025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:37.294495 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:37.295310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:37.295841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:37.437715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:37.447217 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:37.448793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:37.450048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-65f20174-ba18-4504-aa34-ab74c4f84aba tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.167411 May 19 16:52:37.450613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 499/895] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:37 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:37.678874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:37.679699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:37.686143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:37.686598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:37.687377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:37.687816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:37.843544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:37.852162 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1d60d0a9-a8bc-429d-8265-043e8c8a3590 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.177660 May 19 16:52:37.852996 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 500/896] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:37 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:38.240926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:38.241661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:38.251225 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:38.251694 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:38.253239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:38.253239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:38.439699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:38.447700 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f951f228-497e-4692-8dd8-385e5d85cf8a tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.211443 May 19 16:52:38.448275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 501/897] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:38 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:38.452806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-3320bb12-1e58-4b96-a675-d843fd6a87df req-01dc750e-d2cf-47a6-93e9-53113243666c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8395bd9a-4534-4aa5-b2d0-f08d866a9339", "name": "network-vif-plugged", "status": "completed", "tag": "bdcf063e-89c5-4dd4-8d96-078d31278d21"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:38.462012 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3320bb12-1e58-4b96-a675-d843fd6a87df req-01dc750e-d2cf-47a6-93e9-53113243666c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:38.462512 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3320bb12-1e58-4b96-a675-d843fd6a87df req-01dc750e-d2cf-47a6-93e9-53113243666c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:38.477019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-3320bb12-1e58-4b96-a675-d843fd6a87df req-01dc750e-d2cf-47a6-93e9-53113243666c service nova] Creating event network-vif-plugged:bdcf063e-89c5-4dd4-8d96-078d31278d21 for instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 on hv-cinder-84243 May 19 16:52:38.482160 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-3320bb12-1e58-4b96-a675-d843fd6a87df req-01dc750e-d2cf-47a6-93e9-53113243666c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032647 May 19 16:52:38.482767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 502/898] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:52:38.487991 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:38.488687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:38.494905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:38.495358 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:38.496208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:38.496656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:38.521529 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:38.647907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:38.656435 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:38.658002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:38.661042 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-87c881ab-4c0e-4b38-8681-c4ddecc7a6c3 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.177047 May 19 16:52:38.661742 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 503/899] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:38 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:38.869679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:38.870253 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:38.876902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:38.877390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:38.878719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:38.879162 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:39.025825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:39.033627 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1ad97015-1bb9-452b-bc67-52cba69c8a69 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.167810 May 19 16:52:39.035413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 504/900] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:38 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:39.466110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:39.466816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:39.473659 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:39.474121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:39.474915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:39.475359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:39.614317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:39.622606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-685a4ec1-5454-4374-83cd-77c3086707a8 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.160582 May 19 16:52:39.623414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 505/901] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:39 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:39.680430 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:39.681052 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:39.687474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:39.688099 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:39.689073 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:39.689541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:39.839026 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:39.848602 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:39.856055 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:39.856055 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-57dae6d7-2ad1-45af-9d22-857278c24c78 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.178433 May 19 16:52:39.856055 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 506/902] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:39 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:40.054147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:40.054687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:40.061279 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:40.061737 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:40.062535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:40.062983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:40.197256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:40.208063 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:40.216415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-39bed9a3-dccf-449b-bbc5-59cb4c8a509f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.166132 May 19 16:52:40.217216 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 507/903] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:40 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:40.640561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:40.641392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:40.644479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=24 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:40.651149 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:40.651789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:40.652667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:40.653241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:40.809442 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:40.818475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d6b02a37-b910-4585-b4f7-17e9de28ecf7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.182029 May 19 16:52:40.819580 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 508/904] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:40 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:40.872562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:40.873181 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:40.875050 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:40.880719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:40.881197 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:40.882031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:40.882463 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:41.048873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:41.058342 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:41.059971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:41.061316 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-63a46fc7-86f4-49bd-82d1-56b6aa9c38e8 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.193283 May 19 16:52:41.062010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 509/905] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:40 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:41.233567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:41.234098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:41.240958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:41.241466 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:41.242206 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:41.242656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:41.388364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:41.396887 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-999b2e80-4e22-4f75-9bd4-e34f0f69d03e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.167260 May 19 16:52:41.397697 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 510/906] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:41 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:41.836156 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:41.836841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:41.843173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:41.843622 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:41.844407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:41.844848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:41.994597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:42.003447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-605bc787-7eb6-4e79-9cf5-1657ff84cc68 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.170591 May 19 16:52:42.004032 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 511/907] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:41 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:42.080651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:42.081462 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:42.088702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:42.089075 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:42.089880 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:42.090345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:42.231724 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:42.240709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:42.242756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:42.243522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7b497d81-3c3e-4d70-8e47-e67f60eb8135 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.167488 May 19 16:52:42.244103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 512/908] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:42 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:42.414773 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:42.415411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:42.426655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:42.427114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:42.427905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:42.428377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:42.572508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:42.580391 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a14a7dad-a556-47c6-82b5-10b4c43bf64a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.169661 May 19 16:52:42.581218 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 513/909] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:42 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:52:43.021544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:43.022215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:43.028516 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:43.029365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:43.029799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:43.030494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:43.167700 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:43.175269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ace2dc57-ff97-4164-bede-481d7cee10c7 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.158186 May 19 16:52:43.175834 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 514/910] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:43 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:43.262112 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:43.263074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:43.269378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:43.269832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:43.270598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:43.271033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:43.401826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:43.409886 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:43.411406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:43.412568 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a9a5bcbd-11a0-4e72-9d31-02e10b59bce0 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.154302 May 19 16:52:43.413132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 515/911] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:43 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:43.597711 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:43.598375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:43.604691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:43.605142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:43.605932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:43.606369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:43.737833 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:43.745544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-54cb1b58-a404-45e6-b4ee-54d29f338355 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.151652 May 19 16:52:43.746113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 516/912] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:43 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:44.191982 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:44.192642 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:44.199041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:44.199485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:44.200239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:44.200669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:44.329262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:44.337328 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e7ba6639-43d2-4597-a3a5-6443506505d4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.149316 May 19 16:52:44.337890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 517/913] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:44 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:44.430006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:44.430936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:44.437090 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:44.437563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:44.438353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:44.438762 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:44.571931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:44.579985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:44.584451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:44.585702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fbbd0a7e-4b53-46c5-8c54-788571b1c4e4 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.159693 May 19 16:52:44.586337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 518/914] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:44 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:44.763902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:44.764522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:44.771264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:44.771713 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:44.772484 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:44.772922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:44.911598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:44.919198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3544dcf7-9701-4e32-968a-5b1b519f753f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.159207 May 19 16:52:44.919762 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 519/915] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:44 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:45.354566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:45.355234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:45.361912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:45.362362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:45.363126 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:45.363558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:45.367521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:45.497278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:45.505234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4ca8d84f-6da5-49ce-807a-9c001fe16723 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.154474 May 19 16:52:45.505810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 520/916] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:45 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:45.603227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:45.603837 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:45.609821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:45.610271 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:45.611036 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:45.611476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:45.743671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:45.752346 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:45.754341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:45.755515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-10e24585-20e3-420c-b7f2-6ae912daf06e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.156105 May 19 16:52:45.756093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 521/917] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:45 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:45.936464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:45.937074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:45.943156 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:45.943605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:45.944359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:45.944794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:46.073546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:46.081435 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-377c96ba-5603-4e9e-bd1b-ec76bda016fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.148268 May 19 16:52:46.081994 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 522/918] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:45 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:46.523057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:46.523750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:46.530513 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:46.530978 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:46.531739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:46.532176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:46.663707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:46.671029 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b2c18f4a-e4f5-4e5f-9703-1aeda544708d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.152810 May 19 16:52:46.671595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 523/919] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:46 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:46.774741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:46.775434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:46.781772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:46.782235 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:46.783028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:46.783660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:46.919579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:46.927765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:46.929284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:46.930447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7a54150a-e55a-4448-bd72-494107e3f6cd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.161442 May 19 16:52:46.930997 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 524/920] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:46 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:47.098013 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:47.098666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:47.110242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:47.110691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:47.111447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:47.111882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:47.251747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:47.259770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c63a7b55-7c22-46c5-8278-6b47a2ffbbfe tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.165785 May 19 16:52:47.260349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 525/921] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:47 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:47.688261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:47.689238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:47.697629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:47.698085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:47.698853 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:47.699291 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:47.841783 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:47.849793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70555195-d3d5-4e9f-912d-95b327d0d71d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.165791 May 19 16:52:47.850362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 526/922] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:47 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:47.948277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:47.948797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:47.954866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:47.955320 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:47.956095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:47.956538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:48.092844 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:48.105743 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:48.108209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:48.110353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-48931633-f444-4c9f-aef0-2870866ad7b6 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.165745 May 19 16:52:48.111341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 527/923] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:47 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:48.277927 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:48.278479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:48.285310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:48.285760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:48.286512 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:48.286945 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:48.416821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:48.424294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fee816c4-6680-4a57-bf40-93d15d89722a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.150569 May 19 16:52:48.424855 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 528/924] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:48 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:48.867215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:48.867833 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:48.874620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:48.875058 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:48.875824 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:48.876267 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:49.004282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:49.011645 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9eb258be-e156-4bf9-9030-eba986a1f6d2 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.148421 May 19 16:52:49.012207 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 529/925] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:48 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:49.128648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:49.129300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:49.135426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:49.135878 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:49.136653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:49.137091 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:49.269508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:49.277519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:49.279056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:49.280231 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f56543eb-bc32-49db-b443-bd0795aca57a tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.155525 May 19 16:52:49.280799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 530/926] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:49 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:49.440678 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:49.441304 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:49.447596 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:49.448048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:49.448819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:49.449288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:49.581550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:49.588994 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0cb01cf9-7f9c-4d9b-9e29-b8a73b00d773 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.152786 May 19 16:52:49.589589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 531/927] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:49 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:50.028779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:50.029598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:50.036734 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:50.037221 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:50.038004 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:50.038446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:50.169833 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:50.177566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-69e90efa-332c-4523-83fc-baf2498b1715 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.152588 May 19 16:52:50.178122 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 532/928] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:50 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:50.298940 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:50.300111 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:50.306435 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:50.306884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:50.307656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:50.308089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:50.438846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:50.447105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:50.448601 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:50.449788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-330e554d-9094-44da-a9cf-eb92df0b06d7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.154815 May 19 16:52:50.450342 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 533/929] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:50 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:50.605835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:50.606446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:50.612891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:50.613376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:50.614153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:50.614594 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:50.744475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:50.752188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b4995f53-5996-46d1-b9fc-a9cc15cd2e5f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.150227 May 19 16:52:50.752970 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 534/930] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:50 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:51.194355 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:51.195001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:51.201604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:51.201986 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:51.202752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:51.203194 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:51.415200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:51.422652 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e37d9612-b26a-475b-99ef-96618ac4564d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.232299 May 19 16:52:51.423229 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 535/931] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:51 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:51.467669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:51.468214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:51.474190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:51.474648 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:51.475413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:51.475857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:51.609365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:51.613485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:52:51.618896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:51.620401 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:51.621593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dc480225-f948-4c1c-b804-989ebd05e0f7 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.157789 May 19 16:52:51.622418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 536/932] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:51 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:51.768612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:51.769145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:51.775484 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:51.775935 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:51.776738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:51.777323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:51.918385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:51.926014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-65b02390-9072-488a-abf9-214bb80c9ca8 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1260 microversion: 2.1 time: 0.161829 May 19 16:52:51.926585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 537/933] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:51 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1260 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:52.439661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:52.440827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:52.447495 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:52.447950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:52.448757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:52.449213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:52.586749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:52.594323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dfd19380-328f-4f6b-a593-678d1c1a8a5e tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.158553 May 19 16:52:52.595085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 538/934] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:52 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:52.600848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-b13ed730-3a1e-4346-8e51-a49ac61c8324 req-01c82810-2843-404b-81ff-b06cbc193a7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09c9e04-1f06-49a6-bc87-f6f5f19d6606", "name": "network-vif-plugged", "status": "completed", "tag": "a0aa27fe-54ef-4579-9ec6-c689af6a343c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:52.609066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b13ed730-3a1e-4346-8e51-a49ac61c8324 req-01c82810-2843-404b-81ff-b06cbc193a7a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:52.609490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b13ed730-3a1e-4346-8e51-a49ac61c8324 req-01c82810-2843-404b-81ff-b06cbc193a7a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:52.622781 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-b13ed730-3a1e-4346-8e51-a49ac61c8324 req-01c82810-2843-404b-81ff-b06cbc193a7a service nova] Creating event network-vif-plugged:a0aa27fe-54ef-4579-9ec6-c689af6a343c for instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 on hv-cinder-84243 May 19 16:52:52.628608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-b13ed730-3a1e-4346-8e51-a49ac61c8324 req-01c82810-2843-404b-81ff-b06cbc193a7a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031617 May 19 16:52:52.629285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 539/935] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:52:52.639865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:52.640592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:52.647935 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:52.648550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:52.649370 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:52.649792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:52.796846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:52.805887 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:52.807660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:52.808991 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-16c4e788-a4e7-4079-917b-203e7d413b33 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.173260 May 19 16:52:52.809967 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 540/936] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:52 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:52:52.942686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:52.943293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:52.949680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:52.950135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:52.950908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:52.951341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:53.091692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:53.099739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-529ef148-275d-4635-81c3-9cbaa762f1be tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1444 microversion: 2.1 time: 0.160979 May 19 16:52:53.100299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 541/937] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:52 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1444 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:53.117607 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:53.118341 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:53.124625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:53.125072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:53.125869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:53.126304 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:53.259539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:53.267034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fb01b1f0-0980-44e6-b876-5f4e7d5feb57 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1444 microversion: 2.1 time: 0.155215 May 19 16:52:53.267597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 542/938] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:53 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1444 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:53.611098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:53.611749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:53.617845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:53.618292 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:53.619056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:53.619491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:53.832667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:53.841073 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-87b6ccab-7c70-45f2-9502-6322f9784864 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.234355 May 19 16:52:53.841706 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 543/939] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:53 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:53.846490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:53.847111 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:53.853429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:53.853886 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:53.854667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:53.855108 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:54.092192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:54.100289 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:54.101907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:54.103074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6bc71f17-fb4d-4840-9f43-c2a2c1abe068 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.260406 May 19 16:52:54.103621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 544/940] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:53 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:54.645175 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-289fdb18-416c-43f4-ac6c-f383616c0846 req-ccff3a59-18f4-4e63-b209-fd9d5892d573 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd294276-db1b-4d22-a56c-4521ea0d0eac", "name": "network-vif-plugged", "status": "completed", "tag": "66429d3e-5852-4dce-a0ad-1c45010f9bbf"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:54.653936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-289fdb18-416c-43f4-ac6c-f383616c0846 req-ccff3a59-18f4-4e63-b209-fd9d5892d573 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:54.654379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-289fdb18-416c-43f4-ac6c-f383616c0846 req-ccff3a59-18f4-4e63-b209-fd9d5892d573 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:54.665797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-289fdb18-416c-43f4-ac6c-f383616c0846 req-ccff3a59-18f4-4e63-b209-fd9d5892d573 service nova] Creating event network-vif-plugged:66429d3e-5852-4dce-a0ad-1c45010f9bbf for instance fd294276-db1b-4d22-a56c-4521ea0d0eac on hv-cinder-84243 May 19 16:52:54.670584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-289fdb18-416c-43f4-ac6c-f383616c0846 req-ccff3a59-18f4-4e63-b209-fd9d5892d573 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030240 May 19 16:52:54.671361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 545/941] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:52:54.858798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:54.859620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:54.867951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:54.868382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:54.869282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:54.869789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:55.273618 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:55.281981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-77a4311f-a4d5-445a-afe3-4d70abe3de96 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.427301 May 19 16:52:55.282572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 546/942] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:54 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:55.287458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:55.288060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:55.294217 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:55.294668 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:55.295812 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:55.295941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:55.509376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:55.520244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:55.522163 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:55.523083 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4c1126b1-4746-4b93-902a-d7cb28ddc800 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1729 microversion: 2.20 time: 0.239488 May 19 16:52:55.523704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 547/943] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:55 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1729 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:55.663811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-2c235b3d-ebcb-4163-bd3a-b4bcbb396a13 req-3ad55564-c54b-422c-9a59-7a5b3fe836ba service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8395bd9a-4534-4aa5-b2d0-f08d866a9339", "tag": "bdcf063e-89c5-4dd4-8d96-078d31278d21"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:55.672618 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2c235b3d-ebcb-4163-bd3a-b4bcbb396a13 req-3ad55564-c54b-422c-9a59-7a5b3fe836ba service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:55.673085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-2c235b3d-ebcb-4163-bd3a-b4bcbb396a13 req-3ad55564-c54b-422c-9a59-7a5b3fe836ba service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:55.685815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-2c235b3d-ebcb-4163-bd3a-b4bcbb396a13 req-3ad55564-c54b-422c-9a59-7a5b3fe836ba service nova] Creating event network-changed:bdcf063e-89c5-4dd4-8d96-078d31278d21 for instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 on hv-cinder-84243 May 19 16:52:55.691644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-2c235b3d-ebcb-4163-bd3a-b4bcbb396a13 req-3ad55564-c54b-422c-9a59-7a5b3fe836ba service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031427 May 19 16:52:55.692261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 548/944] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:52:56.299874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:56.300522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:56.306954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:56.307416 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:56.308200 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:56.308647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:56.535092 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:56.544041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-61d73628-c26b-4a38-bf60-8c49ae95b1de tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1367 microversion: 2.1 time: 0.247835 May 19 16:52:56.548051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 549/945] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:56 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1367 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:56.550064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:56.550620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:56.557553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:56.557839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:56.558546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:56.558988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:56.763937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:56.772637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:56.774061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:56.775227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9288d8d8-aa56-43f8-a05c-3c4a5e805131 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1716 microversion: 2.20 time: 0.229508 May 19 16:52:56.776102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 550/946] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:52:56 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1716 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 19 16:52:57.561233 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:57.561783 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:57.567920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:57.568378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:57.569173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:57.569613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:57.697267 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:52:57.704860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-183a439a-cd0c-497f-853f-c976013b7eee tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1557 microversion: 2.1 time: 0.147653 May 19 16:52:57.705537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 551/947] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:52:57 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1557 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:52:57.720508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-10046d97-645e-4815-98d4-3ef475eef6aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:52:57.721510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-10046d97-645e-4815-98d4-3ef475eef6aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:52:57.727388 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10046d97-645e-4815-98d4-3ef475eef6aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:57.727836 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10046d97-645e-4815-98d4-3ef475eef6aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:57.728595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10046d97-645e-4815-98d4-3ef475eef6aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:57.729037 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-10046d97-645e-4815-98d4-3ef475eef6aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:57.809822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-10046d97-645e-4815-98d4-3ef475eef6aa tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092863 May 19 16:52:57.810409 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 552/948] 10.222.0.36 () {58 vars in 1274 bytes} [Thu May 19 16:52:57 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:52:58.727316 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-761a9f78-7b53-4ffe-b1a8-ae7a29f6676c req-aa8e8a7c-628f-43af-a044-8182e409df12 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fd294276-db1b-4d22-a56c-4521ea0d0eac", "tag": "66429d3e-5852-4dce-a0ad-1c45010f9bbf"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:52:58.735596 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-761a9f78-7b53-4ffe-b1a8-ae7a29f6676c req-aa8e8a7c-628f-43af-a044-8182e409df12 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:52:58.736121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-761a9f78-7b53-4ffe-b1a8-ae7a29f6676c req-aa8e8a7c-628f-43af-a044-8182e409df12 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:52:58.748089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-761a9f78-7b53-4ffe-b1a8-ae7a29f6676c req-aa8e8a7c-628f-43af-a044-8182e409df12 service nova] Creating event network-changed:66429d3e-5852-4dce-a0ad-1c45010f9bbf for instance fd294276-db1b-4d22-a56c-4521ea0d0eac on hv-cinder-84243 May 19 16:52:58.753904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-761a9f78-7b53-4ffe-b1a8-ae7a29f6676c req-aa8e8a7c-628f-43af-a044-8182e409df12 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030668 May 19 16:52:58.754588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 553/949] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:52:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:16.872010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=89 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:53:16.872778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=84 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:53:16.876882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-41709d81-e042-4a8e-a527-bb1eea3b1dc2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:16.877494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-41709d81-e042-4a8e-a527-bb1eea3b1dc2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:16.885060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41709d81-e042-4a8e-a527-bb1eea3b1dc2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:16.885537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41709d81-e042-4a8e-a527-bb1eea3b1dc2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:16.886312 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41709d81-e042-4a8e-a527-bb1eea3b1dc2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:16.886757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-41709d81-e042-4a8e-a527-bb1eea3b1dc2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:16.910953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-41709d81-e042-4a8e-a527-bb1eea3b1dc2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/ips" status: 200 len: 145 microversion: 2.1 time: 0.041148 May 19 16:53:16.911604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 554/950] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:53:16 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:18.236083 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-50662cd9-086c-4032-b49b-b29dc9538e7b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "21b954ae-e0b0-4526-b5b4-1f6054f96237"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:53:18.238579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-50662cd9-086c-4032-b49b-b29dc9538e7b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:18.244556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50662cd9-086c-4032-b49b-b29dc9538e7b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:18.245021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50662cd9-086c-4032-b49b-b29dc9538e7b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:18.245945 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50662cd9-086c-4032-b49b-b29dc9538e7b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:18.246304 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-50662cd9-086c-4032-b49b-b29dc9538e7b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:18.609250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-50662cd9-086c-4032-b49b-b29dc9538e7b tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.376959 May 19 16:53:18.609974 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 555/951] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:53:18 2022] POST /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments => generated 194 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:26.094813 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1723d480-68b3-4972-a74c-6100f4a95a28 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:26.095877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1723d480-68b3-4972-a74c-6100f4a95a28 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:26.102649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1723d480-68b3-4972-a74c-6100f4a95a28 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:26.103108 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1723d480-68b3-4972-a74c-6100f4a95a28 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:26.103875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1723d480-68b3-4972-a74c-6100f4a95a28 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:26.104317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1723d480-68b3-4972-a74c-6100f4a95a28 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:26.133828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1723d480-68b3-4972-a74c-6100f4a95a28 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043799 May 19 16:53:26.134373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 556/952] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:53:26 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:26.143661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bda869cd-8b1a-4d30-80b2-f4b01379f9fe tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:26.144087 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bda869cd-8b1a-4d30-80b2-f4b01379f9fe tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:26.149701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda869cd-8b1a-4d30-80b2-f4b01379f9fe tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:26.150153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda869cd-8b1a-4d30-80b2-f4b01379f9fe tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:26.150900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda869cd-8b1a-4d30-80b2-f4b01379f9fe tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:26.151336 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bda869cd-8b1a-4d30-80b2-f4b01379f9fe tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:26.183382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bda869cd-8b1a-4d30-80b2-f4b01379f9fe tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/21b954ae-e0b0-4526-b5b4-1f6054f96237" status: 200 len: 194 microversion: 2.1 time: 0.043270 May 19 16:53:26.183973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 557/953] 10.222.0.36 () {58 vars in 1412 bytes} [Thu May 19 16:53:26 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/21b954ae-e0b0-4526-b5b4-1f6054f96237 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:27.495960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9327565c-b56d-4c30-9bc4-567700e7284a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9ad76e8e-8e42-4f33-9879-2d311e2a6f1c"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:53:27.497321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9327565c-b56d-4c30-9bc4-567700e7284a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:27.503953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9327565c-b56d-4c30-9bc4-567700e7284a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:27.504521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9327565c-b56d-4c30-9bc4-567700e7284a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:27.505329 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9327565c-b56d-4c30-9bc4-567700e7284a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:27.505771 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9327565c-b56d-4c30-9bc4-567700e7284a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:27.744689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9327565c-b56d-4c30-9bc4-567700e7284a tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "POST /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253414 May 19 16:53:27.745340 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 558/954] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:53:27 2022] POST /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:35.239689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c2dd8b84-edb1-4827-a7c9-8795a1de790c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:35.241230 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c2dd8b84-edb1-4827-a7c9-8795a1de790c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:35.247719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2dd8b84-edb1-4827-a7c9-8795a1de790c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:35.248166 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2dd8b84-edb1-4827-a7c9-8795a1de790c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:35.248921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2dd8b84-edb1-4827-a7c9-8795a1de790c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:35.249387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2dd8b84-edb1-4827-a7c9-8795a1de790c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:35.279418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c2dd8b84-edb1-4827-a7c9-8795a1de790c tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044553 May 19 16:53:35.279988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 559/955] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:53:35 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:35.432222 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b5b45fec-37a6-40b5-ac75-83bc80eabb11 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:35.432653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b5b45fec-37a6-40b5-ac75-83bc80eabb11 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:35.439178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5b45fec-37a6-40b5-ac75-83bc80eabb11 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:35.439633 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5b45fec-37a6-40b5-ac75-83bc80eabb11 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:35.440439 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5b45fec-37a6-40b5-ac75-83bc80eabb11 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:35.440883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b5b45fec-37a6-40b5-ac75-83bc80eabb11 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:35.469415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b5b45fec-37a6-40b5-ac75-83bc80eabb11 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/21b954ae-e0b0-4526-b5b4-1f6054f96237" status: 200 len: 194 microversion: 2.1 time: 0.041599 May 19 16:53:35.469982 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 560/956] 10.222.0.36 () {58 vars in 1412 bytes} [Thu May 19 16:53:35 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/21b954ae-e0b0-4526-b5b4-1f6054f96237 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:53:35.478985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:35.479479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:35.485182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:35.485655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:35.486420 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:35.486863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:35.565921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lazy-loading 'services' on Instance uuid 8697fd67-9bdf-4779-9916-dae8319c1a80 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:53:35.634882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0445bd9a-ac03-44be-b78d-475963f743b3 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/21b954ae-e0b0-4526-b5b4-1f6054f96237" status: 202 len: 0 microversion: 2.1 time: 0.159239 May 19 16:53:35.635470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 561/957] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:53:35 2022] DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/21b954ae-e0b0-4526-b5b4-1f6054f96237 => generated 0 bytes in 161 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:53:37.801689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4c434ac5-3f2e-40c8-b4c6-c87904283a53 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:37.802283 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4c434ac5-3f2e-40c8-b4c6-c87904283a53 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:37.808619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c434ac5-3f2e-40c8-b4c6-c87904283a53 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:37.809073 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c434ac5-3f2e-40c8-b4c6-c87904283a53 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:37.809862 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c434ac5-3f2e-40c8-b4c6-c87904283a53 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:37.810304 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4c434ac5-3f2e-40c8-b4c6-c87904283a53 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:37.838791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4c434ac5-3f2e-40c8-b4c6-c87904283a53 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/9ad76e8e-8e42-4f33-9879-2d311e2a6f1c" status: 200 len: 194 microversion: 2.1 time: 0.042096 May 19 16:53:37.839365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 562/958] 10.222.0.36 () {58 vars in 1412 bytes} [Thu May 19 16:53:37 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/9ad76e8e-8e42-4f33-9879-2d311e2a6f1c => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:53:37.848460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:37.848949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:37.854605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:37.855051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:37.855803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:37.856241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:37.935248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lazy-loading 'services' on Instance uuid 8697fd67-9bdf-4779-9916-dae8319c1a80 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:53:38.007636 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-024625ce-6788-4e46-b138-9fc40966caaf tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/9ad76e8e-8e42-4f33-9879-2d311e2a6f1c" status: 202 len: 0 microversion: 2.1 time: 0.162333 May 19 16:53:38.008136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 563/959] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:53:37 2022] DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments/9ad76e8e-8e42-4f33-9879-2d311e2a6f1c => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:53:39.166986 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5c640601-444f-46a5-a4c3-ef51df5353ed tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:39.167977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5c640601-444f-46a5-a4c3-ef51df5353ed tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:39.174105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c640601-444f-46a5-a4c3-ef51df5353ed tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.174549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c640601-444f-46a5-a4c3-ef51df5353ed tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.175305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c640601-444f-46a5-a4c3-ef51df5353ed tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.175739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5c640601-444f-46a5-a4c3-ef51df5353ed tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.202987 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5c640601-444f-46a5-a4c3-ef51df5353ed tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041433 May 19 16:53:39.203519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 564/960] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:53:39 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 16:53:39.308915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9e3c3c6f-7651-497b-b0cd-2ec81bafaf7f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:39.309871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9e3c3c6f-7651-497b-b0cd-2ec81bafaf7f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:39.315925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e3c3c6f-7651-497b-b0cd-2ec81bafaf7f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.316374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e3c3c6f-7651-497b-b0cd-2ec81bafaf7f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.317139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e3c3c6f-7651-497b-b0cd-2ec81bafaf7f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.317600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e3c3c6f-7651-497b-b0cd-2ec81bafaf7f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.346010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9e3c3c6f-7651-497b-b0cd-2ec81bafaf7f tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041079 May 19 16:53:39.346542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 565/961] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:53:39 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 16:53:39.403331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:39.403756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:39.409921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.410378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.411142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.411585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.436343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:53:39.439079 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:53:39.512088 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bd008a50-32f6-4a37-9ad7-5a4d88c8c078 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 204 len: 0 microversion: 2.1 time: 0.112445 May 19 16:53:39.512732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 566/962] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:53:39 2022] DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 16:53:39.521244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:39.522542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:39.528395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.528848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.529643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:39.530082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:39.662760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:53:39.670343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7450a2a8-8a99-4625-a323-e315864bd84d tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1671 microversion: 2.1 time: 0.153090 May 19 16:53:39.670912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 567/963] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:53:39 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:53:40.687947 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:40.688600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:40.695335 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:40.695791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:40.696561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:40.697001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:40.824789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:53:40.832305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72503f78-cb49-4cc2-a8a1-d63620bd0ad8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1671 microversion: 2.1 time: 0.148251 May 19 16:53:40.832893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 568/964] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:53:40 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:53:41.849142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:41.849814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:41.857102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:41.857513 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:41.858564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:41.859049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:42.096787 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4077d35bf1044be79bfaa013e13c530e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fd5d1150a9ed483bbd298b896bcf7f46', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:53:42.105178 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4fea18db-7a04-4b06-93ea-e2785554f1a2 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 200 len: 1671 microversion: 2.1 time: 0.259922 May 19 16:53:42.105756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 569/965] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:53:41 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 1671 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:53:42.541535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-cc4879d5-4214-4184-b59c-2c3ccc4a9540 req-5e56dfd0-8266-41c9-935b-abf75bd73c2a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8697fd67-9bdf-4779-9916-dae8319c1a80", "name": "network-vif-deleted", "tag": "282d2d85-2868-496a-a864-3ec40b6f91a3"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:53:42.560096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cc4879d5-4214-4184-b59c-2c3ccc4a9540 req-5e56dfd0-8266-41c9-935b-abf75bd73c2a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:42.560480 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cc4879d5-4214-4184-b59c-2c3ccc4a9540 req-5e56dfd0-8266-41c9-935b-abf75bd73c2a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:42.573079 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-cc4879d5-4214-4184-b59c-2c3ccc4a9540 req-5e56dfd0-8266-41c9-935b-abf75bd73c2a service nova] Creating event network-vif-deleted:282d2d85-2868-496a-a864-3ec40b6f91a3 for instance 8697fd67-9bdf-4779-9916-dae8319c1a80 on hv-cinder-84243 May 19 16:53:42.577732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-cc4879d5-4214-4184-b59c-2c3ccc4a9540 req-5e56dfd0-8266-41c9-935b-abf75bd73c2a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040347 May 19 16:53:42.578329 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 570/966] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:53:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:53:43.123562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:43.124378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:43.130646 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:43.131038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:43.132361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:43.132803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:43.146029 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] HTTP exception thrown: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Request method failure captured: May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 HTTP/1.1 May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnQBFwGnoVshTieTS7zwhUiAIOqTPNIinzdtV6B4zcZ6d6vxFGsqiZtN1pk-gGoPwH8is8qYvZH7r1sgRUyDuKD8MZ0LFT6m19sYVfM4t7JkqYD87RC-vgeclCndDjcP0SyzDbJZBwu0p3kJa5FVVDIR6lV3qX3z-sHnTEx68WJZK14 May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:53:43.148325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5d1150a9ed483bbd298b896bcf7f46", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 4077d35bf1044be79bfaa013e13c530e May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:43.149794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '8697fd67-9bdf-4779-9916-dae8319c1a80'} May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:53:43.150604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:43.151924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:43.153084 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Returning 404 to user: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:53:43.153084 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b3b41f36-0a92-44ed-8de5-84b116bef46e tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 404 len: 111 microversion: 2.1 time: 0.031240 May 19 16:53:43.153084 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 571/967] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:53:43 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:53:43.158263 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-06227e1a-597e-4e56-b006-674bf03bceec tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '.version_select at 0x7f489372fd30>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:43.175783 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-06227e1a-597e-4e56-b006-674bf03bceec tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782937747" status: 202 len: 0 microversion: 2.1 time: 0.021024 May 19 16:53:43.176558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 572/968] 10.222.0.36 () {58 vars in 1217 bytes} [Thu May 19 16:53:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782937747 => generated 0 bytes in 22 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:53:46.068963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:46.069585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:46.075399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:46.075861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:46.076627 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:46.077069 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:46.091187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] HTTP exception thrown: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Request method failure captured: May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 HTTP/1.1 May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnQBFwGnoVshTieTS7zwhUiAIOqTPNIinzdtV6B4zcZ6d6vxFGsqiZtN1pk-gGoPwH8is8qYvZH7r1sgRUyDuKD8MZ0LFT6m19sYVfM4t7JkqYD87RC-vgeclCndDjcP0SyzDbJZBwu0p3kJa5FVVDIR6lV3qX3z-sHnTEx68WJZK14 May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:53:46.092733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5d1150a9ed483bbd298b896bcf7f46", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 4077d35bf1044be79bfaa013e13c530e May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.094397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '8697fd67-9bdf-4779-9916-dae8319c1a80'} May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:53:46.095318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.096946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.098634 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Returning 404 to user: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:53:46.098634 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5d8a293e-990e-4511-9f3e-def0682b2bd8 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 404 len: 111 microversion: 2.1 time: 0.029725 May 19 16:53:46.098634 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 573/969] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:53:46 2022] DELETE /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:53:46.104617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:46.105277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: 8697fd67-9bdf-4779-9916-dae8319c1a80] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:46.111633 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:46.112093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:46.112875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:46.113419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:46.127741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] HTTP exception thrown: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Request method failure captured: May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 HTTP/1.1 May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnQBFwGnoVshTieTS7zwhUiAIOqTPNIinzdtV6B4zcZ6d6vxFGsqiZtN1pk-gGoPwH8is8qYvZH7r1sgRUyDuKD8MZ0LFT6m19sYVfM4t7JkqYD87RC-vgeclCndDjcP0SyzDbJZBwu0p3kJa5FVVDIR6lV3qX3z-sHnTEx68WJZK14 May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:53:46.129317 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5d1150a9ed483bbd298b896bcf7f46", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 4077d35bf1044be79bfaa013e13c530e May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.130966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '8697fd67-9bdf-4779-9916-dae8319c1a80'} May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:53:46.132019 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. May 19 16:53:46.133470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:46.134823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Returning 404 to user: Instance 8697fd67-9bdf-4779-9916-dae8319c1a80 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:53:46.134823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5d36ba9b-6009-42a8-9688-436464779a68 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80" status: 404 len: 111 microversion: 2.1 time: 0.030609 May 19 16:53:46.134823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 574/970] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:53:46 2022] GET /compute/v2.1/servers/8697fd67-9bdf-4779-9916-dae8319c1a80 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:53:47.268016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:47.268567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:47.270886 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:53:47.276049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:47.276500 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:47.277285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:47.277725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:47.296540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] HTTP exception thrown: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Request method failure captured: May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d HTTP/1.1 May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnQBFwGnoVshTieTS7zwhUiAIOqTPNIinzdtV6B4zcZ6d6vxFGsqiZtN1pk-gGoPwH8is8qYvZH7r1sgRUyDuKD8MZ0LFT6m19sYVfM4t7JkqYD87RC-vgeclCndDjcP0SyzDbJZBwu0p3kJa5FVVDIR6lV3qX3z-sHnTEx68WJZK14 May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:53:47.298331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5d1150a9ed483bbd298b896bcf7f46", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 4077d35bf1044be79bfaa013e13c530e May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.299798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'ec996e03-c5eb-44e0-ad6c-cbe782fd443d'} May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:53:47.300643 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.302064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.303992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Returning 404 to user: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:53:47.303992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9a7f1717-d990-4071-b6c1-adc33bb671f4 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "DELETE /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 404 len: 111 microversion: 2.1 time: 0.035675 May 19 16:53:47.303992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 575/971] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:53:47 2022] DELETE /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:53:47.308620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:53:47.309252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] [instance: ec996e03-c5eb-44e0-ad6c-cbe782fd443d] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:53:47.315055 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:47.315507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:47.316265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:53:47.316703 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:53:47.334919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] HTTP exception thrown: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Request method failure captured: May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d HTTP/1.1 May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnQBFwGnoVshTieTS7zwhUiAIOqTPNIinzdtV6B4zcZ6d6vxFGsqiZtN1pk-gGoPwH8is8qYvZH7r1sgRUyDuKD8MZ0LFT6m19sYVfM4t7JkqYD87RC-vgeclCndDjcP0SyzDbJZBwu0p3kJa5FVVDIR6lV3qX3z-sHnTEx68WJZK14 May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:53:47.336427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_fd5d1150a9ed483bbd298b896bcf7f46", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/fd5d1150a9ed483bbd298b896bcf7f46"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: fd5d1150a9ed483bbd298b896bcf7f46 May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631649491 May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 4077d35bf1044be79bfaa013e13c530e May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeTestJSON-631649491-project May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.338044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'ec996e03-c5eb-44e0-ad6c-cbe782fd443d'} May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:53:47.338951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. May 19 16:53:47.340384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:53:47.341818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] Returning 404 to user: Instance ec996e03-c5eb-44e0-ad6c-cbe782fd443d could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:53:47.341818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6bd28273-b7b9-4333-bf0d-4d1915f6e4c0 tempest-AttachVolumeTestJSON-631649491 tempest-AttachVolumeTestJSON-631649491-project] 10.222.0.36 "GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d" status: 404 len: 111 microversion: 2.1 time: 0.032762 May 19 16:53:47.341818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 576/972] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:53:47 2022] GET /compute/v2.1/servers/ec996e03-c5eb-44e0-ad6c-cbe782fd443d => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:03.882364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-20194f33-ed88-4e97-8d36-b5f2e400641e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:03.883310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-20194f33-ed88-4e97-8d36-b5f2e400641e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:03.885948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:03.886600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:03.891519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20194f33-ed88-4e97-8d36-b5f2e400641e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:03.892061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20194f33-ed88-4e97-8d36-b5f2e400641e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:03.892853 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20194f33-ed88-4e97-8d36-b5f2e400641e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:03.893329 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20194f33-ed88-4e97-8d36-b5f2e400641e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:03.925091 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-20194f33-ed88-4e97-8d36-b5f2e400641e tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047203 May 19 16:54:03.925673 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 577/973] 10.222.0.36 () {60 vars in 1342 bytes} [Thu May 19 16:54:03 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:03.981882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:03.982383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:03.988456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:03.988912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:03.989705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:03.990801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:04.018159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:54:04.091331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-827ed592-e3e5-4304-a9de-2f7ddf43a892 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 204 len: 0 microversion: 2.20 time: 0.112913 May 19 16:54:04.091995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 578/974] 10.222.0.36 () {60 vars in 1279 bytes} [Thu May 19 16:54:03 2022] DELETE /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) May 19 16:54:04.101174 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:04.101883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:04.107607 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:04.108074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:04.108811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:04.109280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:04.241790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:04.249892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:04.251396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:04.252714 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5dd6a61a-794d-489a-8f80-6fb390c979b2 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.156205 May 19 16:54:04.253296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 579/975] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:54:04 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:54:05.270687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:05.271336 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:05.277975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:05.278435 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:05.279204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:05.279649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:05.406343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:05.414433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:05.415943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:05.417112 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-40725763-14a5-44e1-a9ed-566ae0eeb5fd tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1722 microversion: 2.20 time: 0.150362 May 19 16:54:05.417682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 580/976] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:54:05 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1722 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:54:06.435023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:06.435731 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:06.442243 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:06.442707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:06.444022 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:06.444647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:06.515814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:06.525469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:06.527002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '86b78ffb46894509bf8e81a154073885', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bef5d1b475ef4228a77b87964b0b8ce1', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:06.528177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-74ab9a04-b44e-4848-8b6e-55ed3c6d6d26 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 200 len: 1655 microversion: 2.20 time: 0.097149 May 19 16:54:06.528933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 581/977] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:54:06 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 1655 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 19 16:54:07.066121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-a41d010f-e165-4c62-bd65-202f33d4b32c req-1bf816b0-7fd9-437e-81ec-3c543a4447e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b09c9e04-1f06-49a6-bc87-f6f5f19d6606", "name": "network-vif-deleted", "tag": "a0aa27fe-54ef-4579-9ec6-c689af6a343c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:07.074246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a41d010f-e165-4c62-bd65-202f33d4b32c req-1bf816b0-7fd9-437e-81ec-3c543a4447e2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:07.074707 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-a41d010f-e165-4c62-bd65-202f33d4b32c req-1bf816b0-7fd9-437e-81ec-3c543a4447e2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:07.085698 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-a41d010f-e165-4c62-bd65-202f33d4b32c req-1bf816b0-7fd9-437e-81ec-3c543a4447e2 service nova] Creating event network-vif-deleted:a0aa27fe-54ef-4579-9ec6-c689af6a343c for instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 on hv-cinder-84243 May 19 16:54:07.094813 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-a41d010f-e165-4c62-bd65-202f33d4b32c req-1bf816b0-7fd9-437e-81ec-3c543a4447e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.186679 May 19 16:54:07.095722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 582/978] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:54:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:54:07.547448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:07.548102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:07.554275 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:07.554722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:07.555520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:07.555961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:07.571841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] HTTP exception thrown: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Request method failure captured: May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 HTTP/1.1 May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOjmR4HZtXBD3Sz12dQYTY0RZpc5zZzjp50yFFwL81AsEBpfMxffLBh0sgWCvJC2qU8NyyD0kmOO_3kkPebbc2uZDm3YGtR22IyRKBj8hdv7-FKeXW6LV71UcH6N2zC5R5M_PQb8sobeio7MS_bKtM8pcjJR4C9iTqDfk5TNJrOL3U May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Openstack-Nova-Api-Version: 2.20 May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:07.573538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bef5d1b475ef4228a77b87964b0b8ce1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 86b78ffb46894509bf8e81a154073885 May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:07.574983 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'b09c9e04-1f06-49a6-bc87-f6f5f19d6606'} May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:07.575909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:07.577321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:07.578417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Returning 404 to user: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:07.578417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f0194e42-22a8-47a7-a676-a4e5591624c1 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 404 len: 111 microversion: 2.20 time: 0.032422 May 19 16:54:07.578417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 583/979] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:54:07 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 16:54:07.583531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a96e4839-4e75-49ad-b739-32f039b42e0f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '.version_select at 0x7f48936f93a0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:07.602318 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a96e4839-4e75-49ad-b739-32f039b42e0f tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-817010839" status: 204 len: 0 microversion: 2.20 time: 0.022290 May 19 16:54:07.605210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 584/980] 10.222.0.36 () {60 vars in 1258 bytes} [Thu May 19 16:54:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-817010839 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 19 16:54:09.376634 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:09.377228 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:09.384882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:09.385374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:09.386161 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:09.386629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:09.400227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] HTTP exception thrown: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Request method failure captured: May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 HTTP/1.1 May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOjmR4HZtXBD3Sz12dQYTY0RZpc5zZzjp50yFFwL81AsEBpfMxffLBh0sgWCvJC2qU8NyyD0kmOO_3kkPebbc2uZDm3YGtR22IyRKBj8hdv7-FKeXW6LV71UcH6N2zC5R5M_PQb8sobeio7MS_bKtM8pcjJR4C9iTqDfk5TNJrOL3U May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Openstack-Nova-Api-Version: 2.20 May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:09.401814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bef5d1b475ef4228a77b87964b0b8ce1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 86b78ffb46894509bf8e81a154073885 May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.403427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'b09c9e04-1f06-49a6-bc87-f6f5f19d6606'} May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:09.404254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.405514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.406769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Returning 404 to user: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:09.406769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c6e09a3a-baa1-4e6f-bd4c-f037fff35bd9 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 404 len: 111 microversion: 2.20 time: 0.030457 May 19 16:54:09.406769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 585/981] 10.222.0.36 () {60 vars in 1279 bytes} [Thu May 19 16:54:09 2022] DELETE /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 16:54:09.413279 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:09.413897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: b09c9e04-1f06-49a6-bc87-f6f5f19d6606] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:09.419743 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:09.420207 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:09.420973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:09.421453 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:09.434676 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] HTTP exception thrown: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Request method failure captured: May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 HTTP/1.1 May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOjmR4HZtXBD3Sz12dQYTY0RZpc5zZzjp50yFFwL81AsEBpfMxffLBh0sgWCvJC2qU8NyyD0kmOO_3kkPebbc2uZDm3YGtR22IyRKBj8hdv7-FKeXW6LV71UcH6N2zC5R5M_PQb8sobeio7MS_bKtM8pcjJR4C9iTqDfk5TNJrOL3U May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Openstack-Nova-Api-Version: 2.20 May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:09.436209 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bef5d1b475ef4228a77b87964b0b8ce1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 86b78ffb46894509bf8e81a154073885 May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.437975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'b09c9e04-1f06-49a6-bc87-f6f5f19d6606'} May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:09.438852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. May 19 16:54:09.440196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:09.441424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Returning 404 to user: Instance b09c9e04-1f06-49a6-bc87-f6f5f19d6606 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:09.441424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3397e086-dd48-431a-a78b-185aa0cb008c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606" status: 404 len: 111 microversion: 2.20 time: 0.027937 May 19 16:54:09.441424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 586/982] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:54:09 2022] GET /compute/v2.1/servers/b09c9e04-1f06-49a6-bc87-f6f5f19d6606 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 19 16:54:10.578340 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:10.578970 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:10.585978 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:10.586424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:10.587180 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:10.587614 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:10.601390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] HTTP exception thrown: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Request method failure captured: May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 HTTP/1.1 May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOjmR4HZtXBD3Sz12dQYTY0RZpc5zZzjp50yFFwL81AsEBpfMxffLBh0sgWCvJC2qU8NyyD0kmOO_3kkPebbc2uZDm3YGtR22IyRKBj8hdv7-FKeXW6LV71UcH6N2zC5R5M_PQb8sobeio7MS_bKtM8pcjJR4C9iTqDfk5TNJrOL3U May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Openstack-Nova-Api-Version: 2.20 May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:10.602926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bef5d1b475ef4228a77b87964b0b8ce1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 86b78ffb46894509bf8e81a154073885 May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.604620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '3a6d6a59-35a3-46b0-a92a-a3ae729071b7'} May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:10.605699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.607266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.608826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Returning 404 to user: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:10.608826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-12a3cfb1-e397-48b5-8588-8b6dde57a33c tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "DELETE /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 404 len: 111 microversion: 2.20 time: 0.029908 May 19 16:54:10.608826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 587/983] 10.222.0.36 () {60 vars in 1279 bytes} [Thu May 19 16:54:10 2022] DELETE /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 16:54:10.612199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:10.612833 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] [instance: 3a6d6a59-35a3-46b0-a92a-a3ae729071b7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:10.618607 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:10.619064 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:10.619811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:10.620302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:10.633752 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] HTTP exception thrown: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Request method failure captured: May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 HTTP/1.1 May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOjmR4HZtXBD3Sz12dQYTY0RZpc5zZzjp50yFFwL81AsEBpfMxffLBh0sgWCvJC2qU8NyyD0kmOO_3kkPebbc2uZDm3YGtR22IyRKBj8hdv7-FKeXW6LV71UcH6N2zC5R5M_PQb8sobeio7MS_bKtM8pcjJR4C9iTqDfk5TNJrOL3U May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Openstack-Nova-Api-Version: 2.20 May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:10.635258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_bef5d1b475ef4228a77b87964b0b8ce1", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/bef5d1b475ef4228a77b87964b0b8ce1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: bef5d1b475ef4228a77b87964b0b8ce1 May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-2024088847 May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 86b78ffb46894509bf8e81a154073885 May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeShelveTestJSON-2024088847-project May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.636908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '3a6d6a59-35a3-46b0-a92a-a3ae729071b7'} May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:10.637730 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. May 19 16:54:10.638915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:10.639977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] Returning 404 to user: Instance 3a6d6a59-35a3-46b0-a92a-a3ae729071b7 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:10.639977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-123af787-1bd9-4b6b-8592-bf42b5e18711 tempest-AttachVolumeShelveTestJSON-2024088847 tempest-AttachVolumeShelveTestJSON-2024088847-project] 10.222.0.36 "GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7" status: 404 len: 111 microversion: 2.20 time: 0.027963 May 19 16:54:10.639977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 588/984] 10.222.0.36 () {60 vars in 1276 bytes} [Thu May 19 16:54:10 2022] GET /compute/v2.1/servers/3a6d6a59-35a3-46b0-a92a-a3ae729071b7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 19 16:54:21.153846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=30,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:21.154597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:21.357214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c048aabe-4d36-433c-b8b3-89d9f26b9387 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:21.357722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c048aabe-4d36-433c-b8b3-89d9f26b9387 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:21.363613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c048aabe-4d36-433c-b8b3-89d9f26b9387 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:21.364068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c048aabe-4d36-433c-b8b3-89d9f26b9387 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:21.365478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c048aabe-4d36-433c-b8b3-89d9f26b9387 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:21.365933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c048aabe-4d36-433c-b8b3-89d9f26b9387 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:21.388519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c048aabe-4d36-433c-b8b3-89d9f26b9387 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/ips" status: 200 len: 150 microversion: 2.1 time: 0.239875 May 19 16:54:21.389057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 589/985] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:54:21 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/ips => generated 150 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:54:25.848793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0e938498-6c16-48da-a3d0-bb763774d39c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1aab2f24-e60c-4a30-86fa-189ac1b24fae"}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:25.850006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0e938498-6c16-48da-a3d0-bb763774d39c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:25.856230 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0e938498-6c16-48da-a3d0-bb763774d39c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:25.856684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0e938498-6c16-48da-a3d0-bb763774d39c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:25.857469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0e938498-6c16-48da-a3d0-bb763774d39c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:25.857912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0e938498-6c16-48da-a3d0-bb763774d39c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:26.096027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0e938498-6c16-48da-a3d0-bb763774d39c tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "POST /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.251169 May 19 16:54:26.096657 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 590/986] 10.222.0.36 () {60 vars in 1322 bytes} [Thu May 19 16:54:25 2022] POST /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments => generated 194 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:54:31.853556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1614739349", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "networks": [{"uuid": "9fd571e0-cea6-467a-8ce2-76303169e116"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:31.905833 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] validate_networks() for [('9fd571e0-cea6-467a-8ce2-76303169e116', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:54:32.365916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:54:32.366345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:54:32.366863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:54:32.367302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:54:32.367715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:54:32.377572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:32.378022 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:32.378828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:32.379264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:32.395624 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Getting quotas for project efe37371967543a3aa0834579ad5e714. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:54:32.399552 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Getting quotas for user 8d0d2a7bb14c44a3b28a11274a3a351e and project efe37371967543a3aa0834579ad5e714. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:54:32.410190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:54:32.412977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:54:32.458652 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-45b55b27-0781-4ffe-ad85-2855445b488e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.609924 May 19 16:54:32.459461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 591/987] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:54:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 611 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:54:32.470172 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fc20eb7b-2996-4ca7-a15d-f2d4e2a9df25 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:32.470873 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fc20eb7b-2996-4ca7-a15d-f2d4e2a9df25 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:32.541920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fc20eb7b-2996-4ca7-a15d-f2d4e2a9df25 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:32.549952 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fc20eb7b-2996-4ca7-a15d-f2d4e2a9df25 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1214 microversion: 2.1 time: 0.084470 May 19 16:54:32.550526 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 592/988] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:32 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:33.567608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:33.569015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:33.576850 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:33.577355 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:33.578141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:33.578827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:33.683219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:33.691525 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-959c4be0-e9b5-4e1c-aea2-e7a6aeb632e7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1284 microversion: 2.1 time: 0.127691 May 19 16:54:33.694125 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 593/989] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:33 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1284 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:33.783790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:33.784211 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:33.791205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:33.791903 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:33.792685 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:33.793198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:33.884788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lazy-loading 'services' on Instance uuid fd294276-db1b-4d22-a56c-4521ea0d0eac {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:54:33.964379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5ee43e30-db66-4e48-80f8-2e7d6b1e5cdb tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments/1aab2f24-e60c-4a30-86fa-189ac1b24fae" status: 202 len: 0 microversion: 2.1 time: 0.184228 May 19 16:54:33.964971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 594/990] 10.222.0.36 () {58 vars in 1415 bytes} [Thu May 19 16:54:33 2022] DELETE /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments/1aab2f24-e60c-4a30-86fa-189ac1b24fae => generated 0 bytes in 186 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:54:33.978448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bb7691d7-d194-4826-ad07-1cab468e9ee4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:33.979690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bb7691d7-d194-4826-ad07-1cab468e9ee4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:33.986255 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb7691d7-d194-4826-ad07-1cab468e9ee4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:33.986715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb7691d7-d194-4826-ad07-1cab468e9ee4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:33.987572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb7691d7-d194-4826-ad07-1cab468e9ee4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:33.988016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb7691d7-d194-4826-ad07-1cab468e9ee4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:34.025650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bb7691d7-d194-4826-ad07-1cab468e9ee4 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055975 May 19 16:54:34.026796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 595/991] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:54:33 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:54:34.710783 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:34.711843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:34.720819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:34.721139 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:34.722143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:34.722775 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:34.953661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:34.962457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0ab96afa-1d36-4b5f-9813-0f267bfc40be tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.256145 May 19 16:54:34.963393 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 596/992] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:34 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:35.037680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ac2971eb-c51a-4c4d-b680-e273c04573ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:35.038713 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ac2971eb-c51a-4c4d-b680-e273c04573ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:35.045373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac2971eb-c51a-4c4d-b680-e273c04573ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.046120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac2971eb-c51a-4c4d-b680-e273c04573ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.046949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac2971eb-c51a-4c4d-b680-e273c04573ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.047400 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac2971eb-c51a-4c4d-b680-e273c04573ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.076771 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ac2971eb-c51a-4c4d-b680-e273c04573ff tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043640 May 19 16:54:35.077375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 597/993] 10.222.0.36 () {58 vars in 1301 bytes} [Thu May 19 16:54:35 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 19 16:54:35.106220 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-3365b7a1-ccbb-4931-ad00-4ac831a1070c req-99eb6695-77c1-4601-8f5d-73da7fb0a32c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "98705bd3-a1c5-4dff-8406-9d6d058df9a1", "tag": "e1775c99-cf48-40e9-be9e-065269cc5b0c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:35.115507 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3365b7a1-ccbb-4931-ad00-4ac831a1070c req-99eb6695-77c1-4601-8f5d-73da7fb0a32c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.115962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-3365b7a1-ccbb-4931-ad00-4ac831a1070c req-99eb6695-77c1-4601-8f5d-73da7fb0a32c service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.127993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-3365b7a1-ccbb-4931-ad00-4ac831a1070c req-99eb6695-77c1-4601-8f5d-73da7fb0a32c service nova] Creating event network-changed:e1775c99-cf48-40e9-be9e-065269cc5b0c for instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 on hv-cinder-84243 May 19 16:54:35.132874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-3365b7a1-ccbb-4931-ad00-4ac831a1070c req-99eb6695-77c1-4601-8f5d-73da7fb0a32c service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030369 May 19 16:54:35.133524 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 598/994] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:54:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:54:35.155367 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:35.155950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:35.162891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.163342 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.164102 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.164543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.189907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:54:35.268302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1d09c7dc-ac3e-4d10-ae5c-94ee429da371 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 204 len: 0 microversion: 2.1 time: 0.116977 May 19 16:54:35.270025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 599/995] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:54:35 2022] DELETE /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 16:54:35.278775 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:35.280081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:35.286311 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.287287 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.288079 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.288521 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.433357 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:35.440805 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d30db075-20ee-4ebd-990d-c748c930434d tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1682 microversion: 2.1 time: 0.166206 May 19 16:54:35.441329 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 600/996] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:35 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1682 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:54:35.980224 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:35.980832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:35.987371 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.987813 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:35.988563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:35.988993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:36.112863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:36.120840 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-029dac8d-246f-4103-b449-52316ac17b10 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.144469 May 19 16:54:36.121679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 601/997] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:35 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:36.457196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:36.457807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:36.464302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:36.464747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:36.465532 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:36.465967 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:36.668234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:36.675926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8b195b5f-9f11-4c9a-8a03-5132aca0ed85 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1682 microversion: 2.1 time: 0.222471 May 19 16:54:36.677226 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 602/998] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:36 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1682 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:37.137861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:37.138491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:37.144870 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:37.145369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:37.146677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:37.147120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:37.282319 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:37.289702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8263bd74-1ec4-4b76-af3c-cf40faf41fbc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.155787 May 19 16:54:37.290264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 603/999] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:37 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:37.692558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:37.693186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:37.699324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:37.699776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:37.700534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:37.700972 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:37.718560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:37.831807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:37.839728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9e161f18-37fc-4785-bc05-f5af24a1a66f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1682 microversion: 2.1 time: 0.151029 May 19 16:54:37.840298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 604/1000] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:37 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1682 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:38.306469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:38.307042 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:38.314024 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:38.314477 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:38.315251 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:38.315691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:38.443598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:38.451447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-74ea1489-5fcb-4457-94ac-23b8333fa8fe tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.149054 May 19 16:54:38.452005 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 605/1001] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:38 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:38.856479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:38.857117 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:38.863137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:38.863586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:38.864338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:38.864770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:38.997937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:39.005331 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aea7a06a-605a-4167-b2e2-6aa4a4aa26e0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1682 microversion: 2.1 time: 0.152670 May 19 16:54:39.005889 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 606/1002] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:38 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1682 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:39.468225 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:39.468892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:39.476034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:39.476492 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:39.477287 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:39.477733 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:39.607680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:39.615386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e8d16255-a1ae-434d-b4a4-1caf92ae39fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.151014 May 19 16:54:39.615992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 607/1003] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:39 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:40.022965 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:40.023612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:40.029900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:40.030969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:40.031269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:40.031713 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:40.168405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:40.175943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-04a9ed65-d6ad-413d-b5e0-e35f40b09f23 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1682 microversion: 2.1 time: 0.157510 May 19 16:54:40.176497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 608/1004] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:40 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:40.632490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:40.633108 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:40.640110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:40.640679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:40.641690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:40.642194 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:40.770583 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:40.778077 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f7c61143-9d57-47ef-84f8-7c3af7900f9a tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.150194 May 19 16:54:40.778640 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 609/1005] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:40 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:41.189598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-64a10ee3-6bcb-4e89-b279-fbdf8c6cbfa4 req-af6950a2-8ce9-46f6-955f-2e7cb0b1d68f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd294276-db1b-4d22-a56c-4521ea0d0eac", "name": "network-vif-unplugged", "status": "completed", "tag": "66429d3e-5852-4dce-a0ad-1c45010f9bbf"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:41.198253 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-64a10ee3-6bcb-4e89-b279-fbdf8c6cbfa4 req-af6950a2-8ce9-46f6-955f-2e7cb0b1d68f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:41.198701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-64a10ee3-6bcb-4e89-b279-fbdf8c6cbfa4 req-af6950a2-8ce9-46f6-955f-2e7cb0b1d68f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:41.209264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-64a10ee3-6bcb-4e89-b279-fbdf8c6cbfa4 req-af6950a2-8ce9-46f6-955f-2e7cb0b1d68f service nova] Creating event network-vif-unplugged:66429d3e-5852-4dce-a0ad-1c45010f9bbf for instance fd294276-db1b-4d22-a56c-4521ea0d0eac on hv-cinder-84243 May 19 16:54:41.214816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-64a10ee3-6bcb-4e89-b279-fbdf8c6cbfa4 req-af6950a2-8ce9-46f6-955f-2e7cb0b1d68f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.154371 May 19 16:54:41.215379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 610/1006] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:54:41 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:54:41.220199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:41.220892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:41.227423 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:41.227877 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:41.228634 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:41.229072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:41.362635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:41.370168 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e3263beb-9ef3-406c-ad44-8b59b387b562 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1682 microversion: 2.1 time: 0.153664 May 19 16:54:41.370671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 611/1007] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:41 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1682 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:54:41.795146 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:41.795828 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:41.802470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:41.802924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:41.803708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:41.804148 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:41.933650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:41.940986 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b0daa80-ff9e-47da-8c70-ce333a36192e tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.149777 May 19 16:54:41.941582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 612/1008] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:41 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:42.387319 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:42.387928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:42.389884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:42.395133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:42.395581 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:42.396338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:42.397299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:42.523701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:42.531127 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70981079-1f31-4c17-9cae-aaea673ce681 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1682 microversion: 2.1 time: 0.147651 May 19 16:54:42.531689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 613/1009] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:42 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1682 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:42.959246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:42.959852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:42.962078 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:42.969405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:42.970201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:42.971492 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:42.972143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:43.448322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:43.455975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8ea81950-2507-4446-9f9a-f3d72ee6ca1c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.500755 May 19 16:54:43.456471 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 614/1010] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:42 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:54:43.547941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:43.548853 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:43.557524 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:43.559826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:43.561536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:43.561992 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:43.663671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0695c868a2d844089fcda29ea3653d5c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e200a1b99664fc8b41757e2ae404f50', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:43.675786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-20d29fd1-62e9-496a-bb73-13dc8076920b tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 200 len: 1614 microversion: 2.1 time: 0.131666 May 19 16:54:43.677244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 615/1011] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:43 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 1614 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:43.935058 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-812caccb-5f28-458d-8fdd-8f9221dba9dc req-d9b85ac5-4c03-4ff0-9080-09846ac76b92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fd294276-db1b-4d22-a56c-4521ea0d0eac", "name": "network-vif-deleted", "tag": "66429d3e-5852-4dce-a0ad-1c45010f9bbf"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:43.951149 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-812caccb-5f28-458d-8fdd-8f9221dba9dc req-d9b85ac5-4c03-4ff0-9080-09846ac76b92 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:43.951972 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-812caccb-5f28-458d-8fdd-8f9221dba9dc req-d9b85ac5-4c03-4ff0-9080-09846ac76b92 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:43.968380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-812caccb-5f28-458d-8fdd-8f9221dba9dc req-d9b85ac5-4c03-4ff0-9080-09846ac76b92 service nova] Creating event network-vif-deleted:66429d3e-5852-4dce-a0ad-1c45010f9bbf for instance fd294276-db1b-4d22-a56c-4521ea0d0eac on hv-cinder-84243 May 19 16:54:43.974499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-812caccb-5f28-458d-8fdd-8f9221dba9dc req-d9b85ac5-4c03-4ff0-9080-09846ac76b92 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059084 May 19 16:54:43.976545 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 616/1012] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:54:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:54:44.473998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:44.474777 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:44.481517 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:44.482130 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:44.483136 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:44.483662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:44.624523 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:44.632740 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d0aa1865-2839-4e40-9e76-cfdae5ebab3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.163411 May 19 16:54:44.633347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 617/1013] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:44 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:54:44.694969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:44.695750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:44.701898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:44.702354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:44.703122 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:44.703566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:44.717588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac HTTP/1.1 May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:44.719290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:44.720914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'fd294276-db1b-4d22-a56c-4521ea0d0eac'} May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:44.721786 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:44.723067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:44.724208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:44.724208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c26ea274-2fae-4c19-8b4d-798834dacf0f tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 404 len: 111 microversion: 2.1 time: 0.030299 May 19 16:54:44.724208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 618/1014] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:44 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:44.729865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bae4fed0-0b12-4363-b2b1-e81af86a3434 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '.version_select at 0x7f489358b280>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:44.753800 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bae4fed0-0b12-4363-b2b1-e81af86a3434 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-587170352" status: 202 len: 0 microversion: 2.1 time: 0.027413 May 19 16:54:44.754742 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 619/1015] 10.222.0.36 () {58 vars in 1217 bytes} [Thu May 19 16:54:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-587170352 => generated 0 bytes in 29 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 19 16:54:45.136694 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-cdd91225-6155-4d14-b9c5-e2152e02d447 req-b1aaa123-d848-425a-a741-66b95f550544 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98705bd3-a1c5-4dff-8406-9d6d058df9a1", "name": "network-vif-plugged", "status": "completed", "tag": "e1775c99-cf48-40e9-be9e-065269cc5b0c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:45.147279 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cdd91225-6155-4d14-b9c5-e2152e02d447 req-b1aaa123-d848-425a-a741-66b95f550544 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:45.147741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cdd91225-6155-4d14-b9c5-e2152e02d447 req-b1aaa123-d848-425a-a741-66b95f550544 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:45.159898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-cdd91225-6155-4d14-b9c5-e2152e02d447 req-b1aaa123-d848-425a-a741-66b95f550544 service nova] Creating event network-vif-plugged:e1775c99-cf48-40e9-be9e-065269cc5b0c for instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 on hv-cinder-84243 May 19 16:54:45.166338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-cdd91225-6155-4d14-b9c5-e2152e02d447 req-b1aaa123-d848-425a-a741-66b95f550544 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033829 May 19 16:54:45.167515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 620/1016] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:54:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:54:45.651365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:45.652104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:45.658364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:45.658827 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:45.659603 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:45.660048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:45.792361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:45.799790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f111c30c-6b9c-41b5-935d-78b1d78151db tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.153193 May 19 16:54:45.800357 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 621/1017] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:45 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:46.640373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:46.640952 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:46.648266 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:46.648720 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:46.649538 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:46.649984 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:46.663790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac HTTP/1.1 May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:46.665475 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.667354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'fd294276-db1b-4d22-a56c-4521ea0d0eac'} May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:46.668464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.670152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.672021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:46.672021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-deacc52f-0b42-4a91-87c1-608f2f81d162 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 404 len: 111 microversion: 2.1 time: 0.030426 May 19 16:54:46.672021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 622/1018] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:54:46 2022] DELETE /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:46.675323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:46.675928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: fd294276-db1b-4d22-a56c-4521ea0d0eac] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:46.681965 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:46.682446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:46.683214 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:46.683661 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:46.697469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac HTTP/1.1 May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:46.698973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.700563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'fd294276-db1b-4d22-a56c-4521ea0d0eac'} May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:46.701399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. May 19 16:54:46.702644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:46.703757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance fd294276-db1b-4d22-a56c-4521ea0d0eac could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:46.703757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1904fb49-1e69-4f71-8063-905b765f1ae0 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac" status: 404 len: 111 microversion: 2.1 time: 0.028788 May 19 16:54:46.703757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 623/1019] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:46 2022] GET /compute/v2.1/servers/fd294276-db1b-4d22-a56c-4521ea0d0eac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:46.816818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:46.817460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:46.823508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:46.823968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:46.824731 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:46.825188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:46.960236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:46.967597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7a3d6a7e-edb5-49be-b5db-091763c5bfed tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1314 microversion: 2.1 time: 0.154732 May 19 16:54:46.968156 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 624/1020] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:46 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:47.859347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:47.860494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:47.868309 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.868818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.869651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.870097 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.886386 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 HTTP/1.1 May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:47.888412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.889822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '5b9cc1c6-d6f1-41fb-b66f-cc33947583d6'} May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:47.890608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.891975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.894245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:47.898807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c964599e-b4e1-4742-ada1-1d6979e189a9 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 404 len: 111 microversion: 2.1 time: 0.043273 May 19 16:54:47.907351 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 625/1021] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:54:47 2022] DELETE /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 111 bytes in 52 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:54:47.912971 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:47.913724 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:47.916731 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:47.920215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.920674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.921496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.923638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.941385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 HTTP/1.1 May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:47.942975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.945203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '5b9cc1c6-d6f1-41fb-b66f-cc33947583d6'} May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:47.946387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. May 19 16:54:47.947968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.949950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance 5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:47.949950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c14f9d22-7be8-47dd-a2ed-8ade751e79d5 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6" status: 404 len: 111 microversion: 2.1 time: 0.036541 May 19 16:54:47.949950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 626/1022] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:47 2022] GET /compute/v2.1/servers/5b9cc1c6-d6f1-41fb-b66f-cc33947583d6 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:54:47.953548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:47.954053 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:47.960544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.961082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.961930 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.962376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.976642 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 HTTP/1.1 May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:47.978212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:47.979584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '23b20a85-cbdd-4162-a605-e79b237afbb7'} May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:47.980359 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:47.981920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:47.983625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:47.983625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6608601b-ac7b-4856-94ab-eeeed497cace tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 404 len: 111 microversion: 2.1 time: 0.030081 May 19 16:54:47.983625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 627/1023] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:54:47 2022] DELETE /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:47.986301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:47.986953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:47.993381 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.993792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.994563 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:47.995003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:47.999282 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:54:48.129674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:48.137613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e0192c86-cd64-4460-9945-ca363033bede tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1499 microversion: 2.1 time: 0.156451 May 19 16:54:48.138181 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 628/1024] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:47 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1499 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:48.142849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:48.143460 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: 23b20a85-cbdd-4162-a605-e79b237afbb7] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:48.149852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:48.150315 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:48.151223 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:48.151803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:48.168449 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 HTTP/1.1 May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:48.170514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:48.172473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '23b20a85-cbdd-4162-a605-e79b237afbb7'} May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:48.173406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. May 19 16:54:48.175819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:48.177458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance 23b20a85-cbdd-4162-a605-e79b237afbb7 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:48.177458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-daa90ee1-29ce-4053-b0c8-e15bebd32f39 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7" status: 404 len: 111 microversion: 2.1 time: 0.034707 May 19 16:54:48.177458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 629/1025] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:48 2022] GET /compute/v2.1/servers/23b20a85-cbdd-4162-a605-e79b237afbb7 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:54:48.628446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:48.629141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:48.636755 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:48.637224 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:48.638000 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:48.638432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:48.665922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:54:48.745582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8cc681b8-3142-432e-9f31-855554e1ecc5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "DELETE /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 204 len: 0 microversion: 2.1 time: 0.120847 May 19 16:54:48.749548 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 630/1026] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:54:48 2022] DELETE /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 16:54:48.754842 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:48.755589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:48.762150 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:48.762598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:48.763370 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:48.763802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:48.902534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:48.910406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-27acc5f4-8f7f-4401-aefc-8149fa8567c2 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1505 microversion: 2.1 time: 0.159510 May 19 16:54:48.910977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 631/1027] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:48 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1505 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:49.312085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:49.312587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:49.318647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:49.319101 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:49.319864 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:49.320305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:49.334002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c HTTP/1.1 May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:49.336270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.337885 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'b4ff377c-5ccd-40ca-9e51-6bde8aafab8c'} May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:49.338795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.340244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.341716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:49.341716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4bab8f6a-979e-45cc-9d02-262361927153 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "DELETE /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 404 len: 111 microversion: 2.1 time: 0.029461 May 19 16:54:49.341716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 632/1028] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:54:49 2022] DELETE /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:49.345933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:49.346544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] [instance: b4ff377c-5ccd-40ca-9e51-6bde8aafab8c] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:49.353145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:49.353625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:49.354383 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:49.354821 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:49.368943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] HTTP exception thrown: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Request method failure captured: May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c HTTP/1.1 May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnOgM3KE8p3CpHpHbcreE_d1hsOLzKsBZCJ54HVNrKv-HVCqov6Etnrs1NvJwaNPcID1U4J2-yzuz-0LdsVnWJR-XnacHFizNKnXGwGvSz5yNJb-Od2xBn9kU-NTyQ8ZyMiWTncVR3_fS5U6xvNWs1puEj1wEY5iU2yz2bSh6kipCiY May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:49.370508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_3e200a1b99664fc8b41757e2ae404f50", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/3e200a1b99664fc8b41757e2ae404f50"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 3e200a1b99664fc8b41757e2ae404f50 May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1493457525 May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0695c868a2d844089fcda29ea3653d5c May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-AttachVolumeNegativeTest-1493457525-project May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.372364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'b4ff377c-5ccd-40ca-9e51-6bde8aafab8c'} May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:49.373499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. May 19 16:54:49.375096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:49.376405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] Returning 404 to user: Instance b4ff377c-5ccd-40ca-9e51-6bde8aafab8c could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:49.376405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4d5514f3-9bdf-4c06-8f48-c32ff9082615 tempest-AttachVolumeNegativeTest-1493457525 tempest-AttachVolumeNegativeTest-1493457525-project] 10.222.0.36 "GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c" status: 404 len: 111 microversion: 2.1 time: 0.029734 May 19 16:54:49.376405 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 633/1029] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:49 2022] GET /compute/v2.1/servers/b4ff377c-5ccd-40ca-9e51-6bde8aafab8c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:49.928760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:49.929765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:49.937487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:49.938033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:49.938915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:49.939424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:50.154519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:50.162020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aeaa32f2-52d0-465c-976b-a3fa6ce05170 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1505 microversion: 2.1 time: 0.237986 May 19 16:54:50.163532 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 634/1030] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:49 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1505 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:54:51.182135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:51.182794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:51.189826 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:51.190294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:51.191087 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:51.191530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:51.420217 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:51.427839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e3ff8074-29e3-4731-acf9-f6f354c26947 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 200 len: 1463 microversion: 2.1 time: 0.251494 May 19 16:54:51.428413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 635/1031] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:51 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 1463 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:54:51.437502 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-891cd06d-635c-4baf-b97e-1bada987dea7 req-f9841232-ebe7-472c-96ec-6c10d7c74e95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "98705bd3-a1c5-4dff-8406-9d6d058df9a1", "name": "network-vif-deleted", "tag": "e1775c99-cf48-40e9-be9e-065269cc5b0c"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:51.448037 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-891cd06d-635c-4baf-b97e-1bada987dea7 req-f9841232-ebe7-472c-96ec-6c10d7c74e95 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:51.448496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-891cd06d-635c-4baf-b97e-1bada987dea7 req-f9841232-ebe7-472c-96ec-6c10d7c74e95 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:51.461336 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-891cd06d-635c-4baf-b97e-1bada987dea7 req-f9841232-ebe7-472c-96ec-6c10d7c74e95 service nova] Creating event network-vif-deleted:e1775c99-cf48-40e9-be9e-065269cc5b0c for instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 on hv-cinder-84243 May 19 16:54:51.466132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-891cd06d-635c-4baf-b97e-1bada987dea7 req-f9841232-ebe7-472c-96ec-6c10d7c74e95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032291 May 19 16:54:51.466767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 636/1032] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:54:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:54:52.447410 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:52.448285 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: 98705bd3-a1c5-4dff-8406-9d6d058df9a1] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:52.454747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:52.455204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:52.456043 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:52.456426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:52.470412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] HTTP exception thrown: Instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 could not be found. May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Request method failure captured: May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 HTTP/1.1 May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZGFBcf7IXTsSpZrg4dwr_FTbUWKZGEVe7uW5N4mKKLNz3cx1BXwHMM0ElNvkXm282sIJh4T6_Noe2TNECXZ0nlJAOQNDuERo_-TvRKKTkDSEeK-th2vzbU4xFarZq5uQknXRNLICgu-4vgWvpAsb6eqrZElaFhxcKXtZIbXHsxlVA May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: efe37371967543a3aa0834579ad5e714 May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesActionsTest-1819956989 May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:52.471995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/efe37371967543a3aa0834579ad5e714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/efe37371967543a3aa0834579ad5e714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_efe37371967543a3aa0834579ad5e714", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/efe37371967543a3aa0834579ad5e714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesActionsTest-1819956989 May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: efe37371967543a3aa0834579ad5e714 May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesActionsTest-1819956989 May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesActionsTest-1819956989-project May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 8d0d2a7bb14c44a3b28a11274a3a351e May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesActionsTest-1819956989-project May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 could not be found. May 19 16:54:52.473456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '98705bd3-a1c5-4dff-8406-9d6d058df9a1'} May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 could not be found. May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:52.474431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 could not be found. May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 could not be found. May 19 16:54:52.476461 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:52.478779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Returning 404 to user: Instance 98705bd3-a1c5-4dff-8406-9d6d058df9a1 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:52.478779 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-de0956c6-4698-48d3-b248-641bf0e51420 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1" status: 404 len: 111 microversion: 2.1 time: 0.031430 May 19 16:54:52.483307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 637/1033] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:52 2022] GET /compute/v2.1/servers/98705bd3-a1c5-4dff-8406-9d6d058df9a1 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:52.524644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1128508696", "imageRef": "a38acf7c-f05b-4ae0-bf32-c4fc6122346b", "flavorRef": "452", "networks": [{"uuid": "9fd571e0-cea6-467a-8ce2-76303169e116"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:52.586804 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] validate_networks() for [('9fd571e0-cea6-467a-8ce2-76303169e116', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:54:52.987236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:54:52.987881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:54:52.988519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:54:52.989124 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:54:52.989739 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:54:53.012564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:53.013033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:53.013921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:53.014361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:53.035823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Getting quotas for project efe37371967543a3aa0834579ad5e714. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:54:53.040333 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Getting quotas for user 8d0d2a7bb14c44a3b28a11274a3a351e and project efe37371967543a3aa0834579ad5e714. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:54:53.067867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:54:53.072253 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='a38acf7c-f05b-4ae0-bf32-c4fc6122346b',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:54:53.155502 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cb4bc0bf-772c-40d8-8606-924591b84b60 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.634623 May 19 16:54:53.156755 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 638/1034] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:54:52 2022] POST /compute/v2.1/servers => generated 380 bytes in 636 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:54:53.172352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b3cd264-8db6-4d51-b682-d3ed4169ba4d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:53.173479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b3cd264-8db6-4d51-b682-d3ed4169ba4d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:53.288242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9b3cd264-8db6-4d51-b682-d3ed4169ba4d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:53.303130 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b3cd264-8db6-4d51-b682-d3ed4169ba4d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1214 microversion: 2.1 time: 0.137588 May 19 16:54:53.305319 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 639/1035] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:53 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1214 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:54:54.321284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:54.321917 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:54.332234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:54.332671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:54.333508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:54.334509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:54.428537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:54.437094 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-625cbb5a-35bb-45cd-8ac1-7377b2dbfc20 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1272 microversion: 2.1 time: 0.119474 May 19 16:54:54.438245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 640/1036] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:54 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1272 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:54.725353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c26fcad6-f195-4cee-846e-81e1339c679a tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Action: 'create', calling method: .version_select at 0x7f489366e0d0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1485092559", "metadata": {"Type": "work"}}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c26fcad6-f195-4cee-846e-81e1339c679a tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Request method failure captured: May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 122 May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZetiC7_hLX92jPRmheU3rG9HyiHY1VMA4O-uQUDDhBcbTvX4uxkbp9k9Rdy9cICxGVUOVtjuwYD6qt6UUJYgh06xA0fNtyu-gngBDylRT6ABUFmh5SNrTsDin84IJlV0x1ffNdVtHgVAUFv18vQUSJiI4B1IrtwXG0ub4pmhjL5Wc May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:54.739429 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d922e774121418fa6517f9a41082991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d922e774121418fa6517f9a41082991", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0e8ad868bf304fdc807cba52abbd9049 May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1485092559", "metadata": {"Type": "work"}}} May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:54:54.741799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1485092559', 'metadata': {'Type': 'work'}}}} May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise error May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi '#$%' May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:54.742774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 16:54:54.744322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 16:54:54.745591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 19 16:54:54.745591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.745591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c26fcad6-f195-4cee-846e-81e1339c679a tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:54.745591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c26fcad6-f195-4cee-846e-81e1339c679a tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.149797 May 19 16:54:54.745591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 641/1037] 10.222.0.36 () {60 vars in 1155 bytes} [Thu May 19 16:54:54 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 151 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 16:54:54.753050 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-64b069c9-e636-42ae-b6cb-7d85ce9b43c0 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Action: 'create', calling method: .version_select at 0x7f489371e5e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1875999806", "metadata": {"Type": "work"}}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-64b069c9-e636-42ae-b6cb-7d85ce9b43c0 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Request method failure captured: May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 120 May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZetiC7_hLX92jPRmheU3rG9HyiHY1VMA4O-uQUDDhBcbTvX4uxkbp9k9Rdy9cICxGVUOVtjuwYD6qt6UUJYgh06xA0fNtyu-gngBDylRT6ABUFmh5SNrTsDin84IJlV0x1ffNdVtHgVAUFv18vQUSJiI4B1IrtwXG0ub4pmhjL5Wc May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:54.754110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d922e774121418fa6517f9a41082991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d922e774121418fa6517f9a41082991", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0e8ad868bf304fdc807cba52abbd9049 May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1875999806", "metadata": {"Type": "work"}}} May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:54:54.755768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1875999806', 'metadata': {'Type': 'work'}}}} May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise error May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi '0' May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:54.756705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 16:54:54.758098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 16:54:54.759241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 19 16:54:54.759241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.759241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-64b069c9-e636-42ae-b6cb-7d85ce9b43c0 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:54.759241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-64b069c9-e636-42ae-b6cb-7d85ce9b43c0 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008061 May 19 16:54:54.759241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 642/1038] 10.222.0.36 () {60 vars in 1155 bytes} [Thu May 19 16:54:54 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) May 19 16:54:54.766361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6388dc5f-0056-4195-a021-c285e1a22a1f tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Action: 'create', calling method: .version_select at 0x7f48934e80d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1777979136", "metadata": {"Type": "work"}}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6388dc5f-0056-4195-a021-c285e1a22a1f tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Request method failure captured: May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 119 May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZetiC7_hLX92jPRmheU3rG9HyiHY1VMA4O-uQUDDhBcbTvX4uxkbp9k9Rdy9cICxGVUOVtjuwYD6qt6UUJYgh06xA0fNtyu-gngBDylRT6ABUFmh5SNrTsDin84IJlV0x1ffNdVtHgVAUFv18vQUSJiI4B1IrtwXG0ub4pmhjL5Wc May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:54.768852 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d922e774121418fa6517f9a41082991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d922e774121418fa6517f9a41082991", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0e8ad868bf304fdc807cba52abbd9049 May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1777979136", "metadata": {"Type": "work"}}} May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:54:54.770684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1777979136', 'metadata': {'Type': 'work'}}}} May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise error May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi On instance['volume']: May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi '' May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:54.771530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 19 16:54:54.772891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 19 16:54:54.774114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 19 16:54:54.774114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.774114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6388dc5f-0056-4195-a021-c285e1a22a1f tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:54.774114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6388dc5f-0056-4195-a021-c285e1a22a1f tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008183 May 19 16:54:54.774114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 643/1039] 10.222.0.36 () {60 vars in 1155 bytes} [Thu May 19 16:54:54 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 19 16:54:54.779345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4a74c195-8cff-4f57-88d9-a126c421b8bd tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Calling method '.version_select at 0x7f48981d2160>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:54.812387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-4a74c195-8cff-4f57-88d9-a126c421b8bd tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] HTTP exception thrown: Volume tempest-invalid-1254701309 could not be found. May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4a74c195-8cff-4f57-88d9-a126c421b8bd tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Request method failure captured: May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1254701309 HTTP/1.1 May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZetiC7_hLX92jPRmheU3rG9HyiHY1VMA4O-uQUDDhBcbTvX4uxkbp9k9Rdy9cICxGVUOVtjuwYD6qt6UUJYgh06xA0fNtyu-gngBDylRT6ABUFmh5SNrTsDin84IJlV0x1ffNdVtHgVAUFv18vQUSJiI4B1IrtwXG0ub4pmhjL5Wc May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:54.814399 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d922e774121418fa6517f9a41082991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d922e774121418fa6517f9a41082991", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0e8ad868bf304fdc807cba52abbd9049 May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Volume tempest-invalid-1254701309 could not be found. May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'tempest-invalid-1254701309'} May 19 16:54:54.816089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1254701309 could not be found. (HTTP 404) (Request-ID: req-6504ebf2-f90b-4464-a260-bb9e94bdbe95) May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.817048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 16:54:54.818590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1254701309 could not be found. May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:54.820011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1254701309 could not be found. May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1254701309 could not be found. May 19 16:54:54.821501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.822238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4a74c195-8cff-4f57-88d9-a126c421b8bd tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Returning 404 to user: Volume tempest-invalid-1254701309 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:54.823053 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4a74c195-8cff-4f57-88d9-a126c421b8bd tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1254701309" status: 404 len: 99 microversion: 2.1 time: 0.047746 May 19 16:54:54.823620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 644/1040] 10.222.0.36 () {58 vars in 1217 bytes} [Thu May 19 16:54:54 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1254701309 => generated 99 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) May 19 16:54:54.833345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a92f23fc-2756-4f0d-82dd-2130b48c94c6 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004465 May 19 16:54:54.833715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 645/1041] 10.222.0.36 () {58 vars in 1139 bytes} [Thu May 19 16:54:54 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 19 16:54:54.841697 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1d92e804-6425-45a1-927b-ba3a29f29927 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003377 May 19 16:54:54.842125 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 646/1042] 10.222.0.36 () {58 vars in 1136 bytes} [Thu May 19 16:54:54 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 4 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) May 19 16:54:54.851585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d5785b6e-4dc0-4a4c-baff-5f0a727c978e tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Calling method '.version_select at 0x7f48936f9ee0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:54.883758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-d5785b6e-4dc0-4a4c-baff-5f0a727c978e tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] HTTP exception thrown: Volume 54f8170b-8651-4d9a-bb4a-ea9c60fdb543 could not be found. May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d5785b6e-4dc0-4a4c-baff-5f0a727c978e tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Request method failure captured: May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/os-volumes/54f8170b-8651-4d9a-bb4a-ea9c60fdb543 HTTP/1.1 May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZetiC7_hLX92jPRmheU3rG9HyiHY1VMA4O-uQUDDhBcbTvX4uxkbp9k9Rdy9cICxGVUOVtjuwYD6qt6UUJYgh06xA0fNtyu-gngBDylRT6ABUFmh5SNrTsDin84IJlV0x1ffNdVtHgVAUFv18vQUSJiI4B1IrtwXG0ub4pmhjL5Wc May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:54.886237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d922e774121418fa6517f9a41082991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d922e774121418fa6517f9a41082991", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0e8ad868bf304fdc807cba52abbd9049 May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Volume 54f8170b-8651-4d9a-bb4a-ea9c60fdb543 could not be found. May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '54f8170b-8651-4d9a-bb4a-ea9c60fdb543'} May 19 16:54:54.887758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 54f8170b-8651-4d9a-bb4a-ea9c60fdb543 could not be found. (HTTP 404) (Request-ID: req-0865e7b9-4389-40ad-840d-59a19ccf51db) May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.888612 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 19 16:54:54.890147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 54f8170b-8651-4d9a-bb4a-ea9c60fdb543 could not be found. May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 19 16:54:54.891522 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 54f8170b-8651-4d9a-bb4a-ea9c60fdb543 could not be found. May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 54f8170b-8651-4d9a-bb4a-ea9c60fdb543 could not be found. May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d5785b6e-4dc0-4a4c-baff-5f0a727c978e tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Returning 404 to user: Volume 54f8170b-8651-4d9a-bb4a-ea9c60fdb543 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d5785b6e-4dc0-4a4c-baff-5f0a727c978e tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "DELETE /compute/v2.1/os-volumes/54f8170b-8651-4d9a-bb4a-ea9c60fdb543" status: 404 len: 109 microversion: 2.1 time: 0.041030 May 19 16:54:54.893350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 647/1043] 10.222.0.36 () {58 vars in 1247 bytes} [Thu May 19 16:54:54 2022] DELETE /compute/v2.1/os-volumes/54f8170b-8651-4d9a-bb4a-ea9c60fdb543 => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:54:54.897006 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6c95019b-a469-4070-9502-083b13c9ddb9 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Calling method '.version_select at 0x7f489366ed30>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:54.929543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-6c95019b-a469-4070-9502-083b13c9ddb9 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] HTTP exception thrown: Volume 0fafba84-4f77-4f4d-93bd-96a5fd01441b could not be found. May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6c95019b-a469-4070-9502-083b13c9ddb9 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Request method failure captured: May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/os-volumes/0fafba84-4f77-4f4d-93bd-96a5fd01441b HTTP/1.1 May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZetiC7_hLX92jPRmheU3rG9HyiHY1VMA4O-uQUDDhBcbTvX4uxkbp9k9Rdy9cICxGVUOVtjuwYD6qt6UUJYgh06xA0fNtyu-gngBDylRT6ABUFmh5SNrTsDin84IJlV0x1ffNdVtHgVAUFv18vQUSJiI4B1IrtwXG0ub4pmhjL5Wc May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:54:54.931488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/8d922e774121418fa6517f9a41082991"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_8d922e774121418fa6517f9a41082991", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/8d922e774121418fa6517f9a41082991"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: 8d922e774121418fa6517f9a41082991 May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesNegativeTest-104754481 May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 0e8ad868bf304fdc807cba52abbd9049 May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesNegativeTest-104754481-project May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Volume 0fafba84-4f77-4f4d-93bd-96a5fd01441b could not be found. May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '0fafba84-4f77-4f4d-93bd-96a5fd01441b'} May 19 16:54:54.932954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0fafba84-4f77-4f4d-93bd-96a5fd01441b could not be found. (HTTP 404) (Request-ID: req-0525ddbb-a879-418b-9ec3-ddbd06783f12) May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.933938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi item = cinderclient( May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 19 16:54:54.935262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0fafba84-4f77-4f4d-93bd-96a5fd01441b could not be found. May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 19 16:54:54.938269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0fafba84-4f77-4f4d-93bd-96a5fd01441b could not be found. May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0fafba84-4f77-4f4d-93bd-96a5fd01441b could not be found. May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6c95019b-a469-4070-9502-083b13c9ddb9 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] Returning 404 to user: Volume 0fafba84-4f77-4f4d-93bd-96a5fd01441b could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6c95019b-a469-4070-9502-083b13c9ddb9 tempest-VolumesNegativeTest-104754481 tempest-VolumesNegativeTest-104754481-project] 10.222.0.36 "GET /compute/v2.1/os-volumes/0fafba84-4f77-4f4d-93bd-96a5fd01441b" status: 404 len: 109 microversion: 2.1 time: 0.039620 May 19 16:54:54.939651 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 648/1044] 10.222.0.36 () {58 vars in 1244 bytes} [Thu May 19 16:54:54 2022] GET /compute/v2.1/os-volumes/0fafba84-4f77-4f4d-93bd-96a5fd01441b => generated 109 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 19 16:54:55.457950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:55.459894 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:55.469223 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:55.471347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:55.472437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:55.473258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:55.744246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:55.755037 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-09f584b2-22c5-40be-ae25-115312843d0c tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.302588 May 19 16:54:55.755448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 649/1045] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:55 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:55.878846 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-f198590a-dec9-4d42-acd6-c717a194ae94 req-fdc81d86-dfc7-4a52-820f-89148b4ad6bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d07d60d0-973e-4a13-a6b2-11e7b008db94", "tag": "c4a9de4f-1f35-4671-b9bb-91e7cc57ebbb"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:54:55.894988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f198590a-dec9-4d42-acd6-c717a194ae94 req-fdc81d86-dfc7-4a52-820f-89148b4ad6bc service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:55.895869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-f198590a-dec9-4d42-acd6-c717a194ae94 req-fdc81d86-dfc7-4a52-820f-89148b4ad6bc service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:55.909540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-f198590a-dec9-4d42-acd6-c717a194ae94 req-fdc81d86-dfc7-4a52-820f-89148b4ad6bc service nova] Creating event network-changed:c4a9de4f-1f35-4671-b9bb-91e7cc57ebbb for instance d07d60d0-973e-4a13-a6b2-11e7b008db94 on hv-cinder-84243 May 19 16:54:55.915007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-f198590a-dec9-4d42-acd6-c717a194ae94 req-fdc81d86-dfc7-4a52-820f-89148b4ad6bc service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040119 May 19 16:54:55.916020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 650/1046] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:54:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:54:56.776252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:56.777101 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:56.783892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:56.784349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:56.785177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:56.785576 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:56.941905 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:56.950091 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0f24331e-0322-4862-8ae3-7f776033f918 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.178519 May 19 16:54:56.950655 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 651/1047] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:56 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:57.967117 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:57.967770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:57.974290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:57.974749 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:57.975556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:57.975996 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:58.102221 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:58.109617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-fe7a016c-a994-4659-b44a-9bdfeb8dbbbd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.146392 May 19 16:54:58.110182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 652/1048] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:57 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:54:59.127377 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:54:59.127982 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:54:59.135149 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:59.135599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:59.136358 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:54:59.136794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:54:59.282173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:54:59.290113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d6e32182-ab94-4284-95d5-97de397e91df tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.166571 May 19 16:54:59.290677 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 653/1049] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:54:59 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:00.307621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:00.308281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:00.314741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:00.315196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:00.315966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:00.316407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:00.442813 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:00.450180 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e403db45-4f50-4fab-9391-0137fc857455 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.147068 May 19 16:55:00.450782 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 654/1050] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:00 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:01.467738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:01.468389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:01.474778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:01.475228 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:01.476511 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:01.476950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:01.604967 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:01.617334 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-005a7575-c36e-4256-bb07-c1c9cb8b7ae7 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.152597 May 19 16:55:01.618141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 655/1051] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:01 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:02.634447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:02.635078 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:02.641801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:02.642245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:02.642998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:02.643428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:02.774101 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:02.777802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:02.782630 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-87237682-5952-48a0-bc51-8d9b2ee74be5 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.151963 May 19 16:55:02.783212 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 656/1052] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:02 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:03.800975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:03.801638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:03.803396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:03.804059 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:03.811088 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:03.811539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:03.812299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:03.812735 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:03.941938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:03.949288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-28a6d83d-2621-4100-9b1b-120b4e6318fb tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.152700 May 19 16:55:03.949857 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 657/1053] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:03 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:04.966948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:04.967627 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:04.974159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:04.974609 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:04.975368 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:04.975802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:05.113908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:05.122177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-162bf4d2-f9e4-40fa-8021-4bfc5c912be4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.159150 May 19 16:55:05.122747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 658/1054] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:04 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:06.138914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:06.139528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:06.146021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:06.146473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:06.147223 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:06.148260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:06.274580 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:06.282147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f09b2cd6-0e20-4886-beee-48bc0146a8fc tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.147097 May 19 16:55:06.282701 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 659/1055] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:06 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:07.298942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:07.299560 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:07.306791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:07.307246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:07.308013 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:07.308451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:07.438378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:07.445756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e6eb894e-aa0f-4db7-8858-afd831688293 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.150744 May 19 16:55:07.446324 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 660/1056] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:07 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:08.463087 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:08.463721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:08.470166 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:08.470617 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:08.471601 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:08.472041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:08.611879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:08.619868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f272015d-986e-431d-ad38-09a0a9090804 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.161210 May 19 16:55:08.620431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 661/1057] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:08 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:09.637556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:09.638180 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:09.644649 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:09.645105 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:09.645938 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:09.646390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:09.772981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:09.780353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7ac2a43a-7835-41c4-a488-fde395fe71bd tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.146643 May 19 16:55:09.780907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 662/1058] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:09 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:09.958819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-61004d7c-6884-4e56-bb67-59620f68eb5b req-6e34b1e4-b0ef-4726-94be-5fe709fca186 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07d60d0-973e-4a13-a6b2-11e7b008db94", "name": "network-vif-plugged", "status": "completed", "tag": "c4a9de4f-1f35-4671-b9bb-91e7cc57ebbb"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:55:09.967654 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-61004d7c-6884-4e56-bb67-59620f68eb5b req-6e34b1e4-b0ef-4726-94be-5fe709fca186 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:09.968095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-61004d7c-6884-4e56-bb67-59620f68eb5b req-6e34b1e4-b0ef-4726-94be-5fe709fca186 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:09.980903 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-61004d7c-6884-4e56-bb67-59620f68eb5b req-6e34b1e4-b0ef-4726-94be-5fe709fca186 service nova] Creating event network-vif-plugged:c4a9de4f-1f35-4671-b9bb-91e7cc57ebbb for instance d07d60d0-973e-4a13-a6b2-11e7b008db94 on hv-cinder-84243 May 19 16:55:09.986349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-61004d7c-6884-4e56-bb67-59620f68eb5b req-6e34b1e4-b0ef-4726-94be-5fe709fca186 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031411 May 19 16:55:09.986936 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 663/1059] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:55:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:55:10.798912 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:10.799547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:10.807227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:10.807679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:10.808465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:10.808910 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:10.937499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:10.945020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-af0896d0-4c8d-46d9-9c12-c6968fca5f35 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.150482 May 19 16:55:10.945620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 664/1060] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:10 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:11.961562 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:11.962210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:11.968670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:11.969119 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:11.969902 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:11.970336 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:12.098520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:12.105937 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-08fc33a1-e61b-4fde-b7a9-c644fcd5a0a3 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1314 microversion: 2.1 time: 0.148941 May 19 16:55:12.106501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 665/1061] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:11 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:13.122968 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:13.123757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:13.129920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:13.130374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:13.131143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:13.131610 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:13.269018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:13.277208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4d962629-86c7-4ec3-8206-64f4ac9e6aae tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1498 microversion: 2.1 time: 0.158370 May 19 16:55:13.277831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 666/1062] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:13 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1498 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:13.725513 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:13.726578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:13.732485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:13.732944 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:13.733756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:13.734201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:13.760321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:55:13.834681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aa3cb47c-3aac-4309-95bd-762786e2bd3f tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "DELETE /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 204 len: 0 microversion: 2.1 time: 0.113565 May 19 16:55:13.836033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 667/1063] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:55:13 2022] DELETE /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 16:55:13.844765 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:13.845486 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:13.851988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:13.852430 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:13.853227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:13.853671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:13.984197 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:13.991975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-84d7ca49-48dc-4b60-9be3-4d4933b63d7d tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1504 microversion: 2.1 time: 0.151032 May 19 16:55:13.992704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 668/1064] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:13 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:15.009763 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:15.010364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:15.017056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:15.017557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:15.018333 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:15.018776 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:15.151265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:15.158854 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8f97e879-5780-44e3-b68e-b09ed9b4bcee tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1504 microversion: 2.1 time: 0.153627 May 19 16:55:15.159419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 669/1065] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:15 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1504 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:15.811674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-67ef30d8-a0e7-422f-a140-99d96d60a7e6 req-70d877e5-e54e-44c0-bd61-1119164053b4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d07d60d0-973e-4a13-a6b2-11e7b008db94", "name": "network-vif-deleted", "tag": "c4a9de4f-1f35-4671-b9bb-91e7cc57ebbb"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:55:15.816667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:15.821060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-67ef30d8-a0e7-422f-a140-99d96d60a7e6 req-70d877e5-e54e-44c0-bd61-1119164053b4 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:15.821541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-67ef30d8-a0e7-422f-a140-99d96d60a7e6 req-70d877e5-e54e-44c0-bd61-1119164053b4 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:15.833518 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-67ef30d8-a0e7-422f-a140-99d96d60a7e6 req-70d877e5-e54e-44c0-bd61-1119164053b4 service nova] Creating event network-vif-deleted:c4a9de4f-1f35-4671-b9bb-91e7cc57ebbb for instance d07d60d0-973e-4a13-a6b2-11e7b008db94 on hv-cinder-84243 May 19 16:55:15.838465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-67ef30d8-a0e7-422f-a140-99d96d60a7e6 req-70d877e5-e54e-44c0-bd61-1119164053b4 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030581 May 19 16:55:15.839059 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 670/1066] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:55:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:55:16.178954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:16.180476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:16.186861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:16.187404 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:16.188375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:16.188870 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:16.228470 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:16.228919 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:16.229501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lazy-loading 'fault' on Instance uuid d07d60d0-973e-4a13-a6b2-11e7b008db94 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:55:16.276462 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8d0d2a7bb14c44a3b28a11274a3a351e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'efe37371967543a3aa0834579ad5e714', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:16.284081 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1993f7a4-c6e4-4316-974a-ed3f4afd2308 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 200 len: 1304 microversion: 2.1 time: 0.110472 May 19 16:55:16.284792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 671/1067] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:16 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 1304 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:17.302910 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:17.303581 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] [instance: d07d60d0-973e-4a13-a6b2-11e7b008db94] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:17.310121 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:17.310582 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:17.311357 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:17.311803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:17.325373 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] HTTP exception thrown: Instance d07d60d0-973e-4a13-a6b2-11e7b008db94 could not be found. May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Request method failure captured: May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 HTTP/1.1 May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnZGFBcf7IXTsSpZrg4dwr_FTbUWKZGEVe7uW5N4mKKLNz3cx1BXwHMM0ElNvkXm282sIJh4T6_Noe2TNECXZ0nlJAOQNDuERo_-TvRKKTkDSEeK-th2vzbU4xFarZq5uQknXRNLICgu-4vgWvpAsb6eqrZElaFhxcKXtZIbXHsxlVA May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: efe37371967543a3aa0834579ad5e714 May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-VolumesActionsTest-1819956989 May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:55:17.327016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/efe37371967543a3aa0834579ad5e714"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/efe37371967543a3aa0834579ad5e714"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_efe37371967543a3aa0834579ad5e714", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/efe37371967543a3aa0834579ad5e714"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-VolumesActionsTest-1819956989 May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: efe37371967543a3aa0834579ad5e714 May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-VolumesActionsTest-1819956989 May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-VolumesActionsTest-1819956989-project May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 8d0d2a7bb14c44a3b28a11274a3a351e May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-VolumesActionsTest-1819956989-project May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance d07d60d0-973e-4a13-a6b2-11e7b008db94 could not be found. May 19 16:55:17.328670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'd07d60d0-973e-4a13-a6b2-11e7b008db94'} May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d07d60d0-973e-4a13-a6b2-11e7b008db94 could not be found. May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:55:17.329679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d07d60d0-973e-4a13-a6b2-11e7b008db94 could not be found. May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d07d60d0-973e-4a13-a6b2-11e7b008db94 could not be found. May 19 16:55:17.331262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:55:17.332630 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] Returning 404 to user: Instance d07d60d0-973e-4a13-a6b2-11e7b008db94 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:55:17.332630 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4b46d259-d088-4698-ac44-a5ffa4d14ca4 tempest-VolumesActionsTest-1819956989 tempest-VolumesActionsTest-1819956989-project] 10.222.0.36 "GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94" status: 404 len: 111 microversion: 2.1 time: 0.029378 May 19 16:55:17.332630 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 672/1068] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:17 2022] GET /compute/v2.1/servers/d07d60d0-973e-4a13-a6b2-11e7b008db94 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:55:23.024210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:55:23.024704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:23.030981 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:23.031437 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:23.032247 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:23.043017 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:23.051516 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:23.060673 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lazy-loading 'flavor' on Instance uuid 8395bd9a-4534-4aa5-b2d0-f08d866a9339 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:55:23.143147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-df11a7ad-114d-4ba7-9086-0fe101219f8a tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "POST /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339/action" status: 202 len: 0 microversion: 2.1 time: 0.123140 May 19 16:55:23.144588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 673/1069] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:55:23 2022] POST /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339/action => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:55:23.156635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:23.157687 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:23.165038 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:23.165876 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:23.167124 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:23.167746 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:23.338623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:23.349960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dcc38da1-0940-48a7-a0a9-018f01410de5 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.200789 May 19 16:55:23.351161 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 674/1070] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:23 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:24.367907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:24.368575 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:24.375977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:24.376509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:24.377572 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:24.378252 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:24.535327 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:24.546096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-86e32fd2-d8fe-4ceb-b293-d00dd71dad96 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.181916 May 19 16:55:24.546879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 675/1071] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:24 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:25.564922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:25.565619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:25.572131 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:25.572593 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:25.573400 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:25.573847 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:25.705750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:25.713384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-044a3b80-3104-46d7-a9e1-2a4853f99eec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.152827 May 19 16:55:25.713954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 676/1072] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:25 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:26.730469 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:26.731165 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:26.737732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:26.738176 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:26.738928 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:26.739361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:26.871712 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:26.879233 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-637d3bd9-7254-4433-b14e-aebba91db8f7 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.152625 May 19 16:55:26.879801 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 677/1073] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:26 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:27.896182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:27.896799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:27.903410 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:27.903864 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:27.904654 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:27.905095 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:28.036195 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:28.044762 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-77b96139-44af-462c-8ded-9efa1210d4a6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.152379 May 19 16:55:28.045372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 678/1074] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:27 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:29.064143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:29.064804 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:29.081094 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:29.081868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:29.083261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:29.083939 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:29.244679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:29.253380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-70d6de22-33a6-4192-a267-43606b12abee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.195817 May 19 16:55:29.254192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 679/1075] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:29 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:30.273173 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:30.274906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:30.292016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:30.292741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:30.294043 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:30.294867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:30.491799 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:30.502322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ac9917e8-14c1-4aa5-9059-b777c8809f5c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.233236 May 19 16:55:30.503561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 680/1076] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:30 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:31.520070 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:31.520829 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:31.529084 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:31.529637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:31.530448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:31.531099 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:31.726364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:31.736584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-56b22600-667f-4c36-a7da-65039960efb4 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.220422 May 19 16:55:31.738014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 681/1077] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:31 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:32.754086 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:32.755841 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:32.763934 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:32.764675 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:32.765616 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:32.766378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:32.975433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:32.983565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-af7a95b4-68b6-4624-ac08-d923a837188e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.233205 May 19 16:55:32.984152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 682/1078] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:32 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:34.002179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:34.002978 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:34.011519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:34.015446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:34.017599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:34.018638 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:34.189991 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:34.198422 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c8af6ff6-1aa4-4121-8f49-31a660caf66b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.200129 May 19 16:55:34.201196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 683/1079] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:33 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:35.216350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:35.217031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:35.226284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:35.227684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:35.228702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:35.229774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:35.420465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:35.429366 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-cf8b2ede-c9f2-4b70-b0ae-84818e582c05 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.217151 May 19 16:55:35.441658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 684/1080] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:35 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:36.447623 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:36.448977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:36.455591 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:36.456084 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:36.456896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:36.457777 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:36.695869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:36.708442 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-0f1bd0be-6c1b-4d80-bf58-1fab8dfb65d6 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.264428 May 19 16:55:36.709056 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 685/1081] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:36 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:37.729082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:37.729867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:37.738299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:37.738951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:37.740190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:37.740796 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:37.916558 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:37.926490 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72393b06-11f1-4500-90f2-ba6338ed42fb tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.203708 May 19 16:55:37.927626 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 686/1082] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:37 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:38.949438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:38.953015 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:38.970281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:38.971061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:38.972073 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:38.985924 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:39.260706 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:39.273238 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-02699105-e9b9-4964-8dbf-851746b3d68d tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.332565 May 19 16:55:39.283155 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 687/1083] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:38 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:40.290941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:40.291670 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:40.299342 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:40.299803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:40.300784 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:40.301242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:40.306226 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:40.472479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:40.482533 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1790bca2-f0fb-4ffa-985d-9f5debda3e40 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.195442 May 19 16:55:40.483340 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 688/1084] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:40 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:41.499520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:41.500204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:41.506683 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:41.507128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:41.507884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:41.508315 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:41.642481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:41.650427 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9f2448f4-3a4d-4fae-a253-b4944b0ada7f tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.155122 May 19 16:55:41.650988 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 689/1085] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:41 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:42.667831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:42.668497 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:42.675198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:42.675650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:42.676446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:42.676879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:42.813112 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:42.820716 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d9458dd7-b452-49b2-865b-7f23f9cd4401 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.157264 May 19 16:55:42.821310 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 690/1086] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:42 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:43.837553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:43.838166 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:43.844613 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:43.845001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:43.845863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:43.846304 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:43.974680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:43.982347 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-03a336dd-5995-4da4-8002-81eec076b924 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.148624 May 19 16:55:43.982910 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 691/1087] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:43 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:44.998756 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:44.999338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:45.005848 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:45.006293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:45.007052 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:45.007494 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:45.140816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:45.148585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e4d8a5e3-8779-44b7-9294-13d661beb942 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.153959 May 19 16:55:45.149795 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 692/1088] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:44 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:46.167048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:46.168378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:46.175086 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:46.175544 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:46.176473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:46.177021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:46.342158 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:46.350289 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b7219c4-2008-4f0b-981a-8bb87c0d524c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.187823 May 19 16:55:46.350856 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 693/1089] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:46 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:46.807290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-b3bbb95e-aa99-4a03-a8ac-256dbdbc4ff0 req-45f01b88-5bfc-4381-a556-8eb4fed4fb95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8395bd9a-4534-4aa5-b2d0-f08d866a9339", "name": "network-vif-unplugged", "status": "completed", "tag": "bdcf063e-89c5-4dd4-8d96-078d31278d21"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:55:46.810785 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=49 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:46.816867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b3bbb95e-aa99-4a03-a8ac-256dbdbc4ff0 req-45f01b88-5bfc-4381-a556-8eb4fed4fb95 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:46.817418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b3bbb95e-aa99-4a03-a8ac-256dbdbc4ff0 req-45f01b88-5bfc-4381-a556-8eb4fed4fb95 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:46.833185 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.compute.server_external_events [req-b3bbb95e-aa99-4a03-a8ac-256dbdbc4ff0 req-45f01b88-5bfc-4381-a556-8eb4fed4fb95 service nova] Unable to find a host for instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339. Dropping event network-vif-unplugged {{(pid=124122) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 19 16:55:46.834093 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-b3bbb95e-aa99-4a03-a8ac-256dbdbc4ff0 req-45f01b88-5bfc-4381-a556-8eb4fed4fb95 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.031325 May 19 16:55:46.834680 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 694/1090] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 33 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 19 16:55:47.368472 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:47.369089 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:47.375878 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:47.376334 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:47.377094 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:47.377556 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:47.513708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:47.521175 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-abf7d021-d41d-45f4-86c9-2444bf4f8b8c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1510 microversion: 2.1 time: 0.157140 May 19 16:55:47.521750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 695/1091] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:47 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:47.537231 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-4e30c902-f3f1-4b83-a03c-0ff0105862b2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:55:47.537798 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-4e30c902-f3f1-4b83-a03c-0ff0105862b2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:47.543989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e30c902-f3f1-4b83-a03c-0ff0105862b2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:47.544442 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e30c902-f3f1-4b83-a03c-0ff0105862b2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:47.545232 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e30c902-f3f1-4b83-a03c-0ff0105862b2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:47.545671 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-4e30c902-f3f1-4b83-a03c-0ff0105862b2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:47.623954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-4e30c902-f3f1-4b83-a03c-0ff0105862b2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "POST /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339/action" status: 202 len: 0 microversion: 2.1 time: 0.090112 May 19 16:55:47.624550 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 696/1092] 10.222.0.36 () {60 vars in 1277 bytes} [Thu May 19 16:55:47 2022] POST /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339/action => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 16:55:47.632231 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:47.632954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:47.639147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:47.639642 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:47.640566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:47.641000 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:47.874901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:47.882791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-df59b3d5-44ef-4f15-843c-1705a47f74d3 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1518 microversion: 2.1 time: 0.254237 May 19 16:55:47.883867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 697/1093] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:47 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1518 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:48.901778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:48.902476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:48.909536 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:48.910074 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:48.911033 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:48.911565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:49.111600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:49.132530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a0898570-d1f4-4346-8f97-5808076c1857 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1520 microversion: 2.1 time: 0.234863 May 19 16:55:49.133067 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 698/1094] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:48 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:55:50.152353 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:50.152958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:50.160897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:50.161382 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:50.162159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:50.162601 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:50.422639 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:50.432196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1a8e3995-6771-4969-95c3-2299ff1cdfde tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.283976 May 19 16:55:50.433448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 699/1095] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:50 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:51.449900 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:51.450585 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:51.456922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:51.457414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:51.458190 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:51.458635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:51.600229 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:51.612100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bb0153f8-bd85-4fc4-95f3-4339a70d8bee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.165983 May 19 16:55:51.620906 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 700/1096] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:51 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:52.629679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:52.630352 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:52.637597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:52.638420 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:52.639284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:52.639866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:52.779931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:52.787592 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c6706908-d386-43dc-ab88-196f0800f027 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.161882 May 19 16:55:52.788167 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 701/1097] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:52 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:53.806571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:53.807199 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:53.814482 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:53.814960 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:53.816034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:53.816496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:53.952830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:53.960728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c18d153d-9833-47db-871c-f9f1ae988037 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.158547 May 19 16:55:53.961326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 702/1098] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:53 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:54.977104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:54.977788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:54.983862 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:54.984305 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:54.985058 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:54.985509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:55.122100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:55.129602 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-993d3d7f-3e1d-4ec5-8c93-161db30f5cae tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.156355 May 19 16:55:55.130167 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 703/1099] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:54 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:56.146979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:56.147644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:56.154664 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:56.155122 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:56.155881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:56.156320 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:56.174007 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:55:56.292027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:56.299674 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2746dedd-956c-4e7e-b2f6-e56ecc6262ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.156591 May 19 16:55:56.300234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 704/1100] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:56 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:57.316577 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:57.317236 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:57.323579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:57.324031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:57.324794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:57.325269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:57.453428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:57.460823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-25e0df76-1a7e-48a3-afa3-cde1e69c28ea tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.148249 May 19 16:55:57.461939 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 705/1101] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:57 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:58.478509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:58.479144 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:58.485656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:58.486111 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:58.486879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:58.487321 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:58.624530 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:58.632126 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d9851c13-32b2-47b4-a5f5-398a4b3208b9 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.158002 May 19 16:55:58.632689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 706/1102] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:58 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:55:59.649503 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:55:59.650187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:55:59.656618 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:59.657065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:59.657891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:55:59.658328 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:55:59.792458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:55:59.801032 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b4f9fd21-cd20-4598-81f4-9df64d9672df tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.155455 May 19 16:55:59.801656 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 707/1103] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:55:59 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:56:00.818485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:00.819096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:00.825958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:00.826406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:00.827162 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:00.827598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:00.960303 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:00.967845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e56c0ca5-2324-4ad6-869d-fc76132aa51c tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.153223 May 19 16:56:00.969869 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 708/1104] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:00 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:56:01.985868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:01.986565 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:01.993356 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:01.993907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:01.994757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:01.995504 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:02.137378 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:02.144907 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-66a7ac0f-8255-4809-9310-0688decfa0c2 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.163215 May 19 16:56:02.145487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 709/1105] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:01 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:56:03.162976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:03.163604 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:03.170637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:03.171455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:03.172890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:03.173731 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:03.318132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:03.326621 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72fa29b7-7895-4137-8898-231bce74c253 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.167988 May 19 16:56:03.327196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 710/1106] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:03 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:56:04.342605 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:04.343234 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:04.349744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:04.350202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:04.350974 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:04.351419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:04.490034 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:04.505327 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ad76b194-3055-4f74-ad6c-d2dd7393c698 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.166069 May 19 16:56:04.505921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 711/1107] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:04 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:56:05.522957 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:05.523695 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:05.530594 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:05.531316 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:05.532269 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:05.532864 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:05.720763 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:05.728374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ed299db6-6c37-49ab-8d9b-14d8b3c3b359 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.209861 May 19 16:56:05.728949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 712/1108] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:05 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:56:06.747169 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:06.747962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:06.754557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:06.755018 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:06.755794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:06.756242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:06.919944 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:06.932026 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ad1cb4bf-9ebf-456b-81bd-2ca8c1e1321e tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.189387 May 19 16:56:06.932998 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 713/1109] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:06 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:56:06.949396 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-acd76341-23b1-4e8a-b87a-7605eda19533 req-9ae8a879-ab54-4425-a9aa-d3777a4e148a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8395bd9a-4534-4aa5-b2d0-f08d866a9339", "name": "network-vif-plugged", "status": "completed", "tag": "bdcf063e-89c5-4dd4-8d96-078d31278d21"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:56:06.958768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-acd76341-23b1-4e8a-b87a-7605eda19533 req-9ae8a879-ab54-4425-a9aa-d3777a4e148a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:06.959224 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-acd76341-23b1-4e8a-b87a-7605eda19533 req-9ae8a879-ab54-4425-a9aa-d3777a4e148a service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:06.973031 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-acd76341-23b1-4e8a-b87a-7605eda19533 req-9ae8a879-ab54-4425-a9aa-d3777a4e148a service nova] Creating event network-vif-plugged:bdcf063e-89c5-4dd4-8d96-078d31278d21 for instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 on hv-cinder-84243 May 19 16:56:06.978754 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-acd76341-23b1-4e8a-b87a-7605eda19533 req-9ae8a879-ab54-4425-a9aa-d3777a4e148a service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033077 May 19 16:56:06.980293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 714/1110] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:56:07.950829 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:07.951528 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:07.958245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:07.958697 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:07.959457 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:07.959894 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:08.097338 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:08.105379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-57a14385-a955-4f2a-afea-ea5b3a051644 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1576 microversion: 2.1 time: 0.159810 May 19 16:56:08.115003 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 715/1111] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:07 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:56:09.122726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:56:09.123343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:56:09.129931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:09.130387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:09.131159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:56:09.131595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:56:09.275306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:56:09.285872 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-017fff69-1ff4-4cad-a83a-a8245aaf208b tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1563 microversion: 2.1 time: 0.167139 May 19 16:56:09.287144 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 716/1112] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:56:09 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1563 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:09.902128 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=47 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:57:09.903286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=70 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:57:10.089509 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-137d508a-a7b5-4f0e-9e83-480d8bb78974 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Action: 'create', calling method: .version_select at 0x7f4893419c10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-535678048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHVSm2RCU8MvPYFR+ntXOJXpcQddyPqilsBjSNrUJdrcZDlGlZK4NS1p6PXKeO9uNtLGNt3kKGl+RWctCBXjCR0suD8YL1gHOXl459LtK6eD9UoxQheQwPbzPrXnqPRCag=="}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:57:10.103767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-137d508a-a7b5-4f0e-9e83-480d8bb78974 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for project dc95250983234edeb99b67ff4f084416. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:57:10.108379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-137d508a-a7b5-4f0e-9e83-480d8bb78974 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for user aaf1ce6ace6e47d6a170ce17afa5397f and project dc95250983234edeb99b67ff4f084416. Resources: {'key_pairs'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:57:10.132599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-137d508a-a7b5-4f0e-9e83-480d8bb78974 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.236156 May 19 16:57:10.133261 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 717/1113] 10.222.0.36 () {60 vars in 1158 bytes} [Thu May 19 16:57:09 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:57:32.699014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=4 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:57:32.699753 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:57:32.704160 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-147671660", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-535678048", "security_groups": [{"name": "tempest-secgroup-smoke-90520039"}], "block_device_mapping_v2": [{"uuid": "afc66471-8c79-41ef-a2e8-d36128710fe8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d06705e9-9d4e-4712-8321-c61ce7be2560"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:57:32.814570 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] validate_networks() for [('d06705e9-9d4e-4712-8321-c61ce7be2560', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 16:57:33.174129 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 16:57:33.174555 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 16:57:33.175025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 16:57:33.175432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 16:57:33.175845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 16:57:33.184595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:33.185044 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:33.185866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:33.186301 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:33.202307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for project dc95250983234edeb99b67ff4f084416. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 16:57:33.206193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for user aaf1ce6ace6e47d6a170ce17afa5397f and project dc95250983234edeb99b67ff4f084416. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 16:57:33.262300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 16:57:33.264375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afc66471-8c79-41ef-a2e8-d36128710fe8',volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 16:57:33.387205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-956738e6-c1be-4040-be9e-0bdab1f0669f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.689482 May 19 16:57:33.387835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 718/1114] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 16:57:32 2022] POST /compute/v2.1/servers => generated 404 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 16:57:33.400280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e1308f9a-2714-435f-b31b-83f07b0f666c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:33.400893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e1308f9a-2714-435f-b31b-83f07b0f666c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:33.454183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e1308f9a-2714-435f-b31b-83f07b0f666c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:33.460832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e1308f9a-2714-435f-b31b-83f07b0f666c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1093 microversion: 2.1 time: 0.066633 May 19 16:57:33.461426 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 719/1115] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:33 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:34.478237 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b5a64cb1-eb37-45c5-83b6-2014134f0477 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:34.478976 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b5a64cb1-eb37-45c5-83b6-2014134f0477 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:34.536193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b5a64cb1-eb37-45c5-83b6-2014134f0477 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:34.543153 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b5a64cb1-eb37-45c5-83b6-2014134f0477 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1093 microversion: 2.1 time: 0.068690 May 19 16:57:34.543769 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 720/1116] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:34 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:35.559535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a70c8a31-e438-451a-b44b-683617f6c1a5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:35.560182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a70c8a31-e438-451a-b44b-683617f6c1a5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:35.618057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a70c8a31-e438-451a-b44b-683617f6c1a5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:35.625392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a70c8a31-e438-451a-b44b-683617f6c1a5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1093 microversion: 2.1 time: 0.069665 May 19 16:57:35.625965 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 721/1117] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:35 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:36.642159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-af115715-e46b-4546-8665-17c9e9cc1dc0 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:36.642770 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-af115715-e46b-4546-8665-17c9e9cc1dc0 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:36.696049 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-af115715-e46b-4546-8665-17c9e9cc1dc0 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:36.703611 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-af115715-e46b-4546-8665-17c9e9cc1dc0 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1093 microversion: 2.1 time: 0.065796 May 19 16:57:36.704186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 722/1118] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:36 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1093 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:37.720306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:37.720925 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:37.727939 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:37.728400 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:37.729186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:37.729633 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:37.788537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:37.796861 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f1e59901-daab-42d0-b4b1-be87827b77b3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1143 microversion: 2.1 time: 0.080951 May 19 16:57:37.797909 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 723/1119] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:37 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1143 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:38.819387 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:38.820708 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:38.828326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:38.828931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:38.830220 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:38.830875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:38.903465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:38.912920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-020bd66b-8e1c-476a-9183-f3f77eb07312 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1209 microversion: 2.1 time: 0.098839 May 19 16:57:38.913540 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 724/1120] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:38 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1209 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:39.735993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-aa68c74f-a3c7-4c6a-b738-5c06a4104329 req-b00e2e01-bb6f-40e5-9d58-6202fa9b0da2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8d525a-8e08-4125-aaeb-0fd017f9d657", "tag": "435b47ce-35db-4c9d-8774-e27fe5c158f8"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:57:39.747170 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-aa68c74f-a3c7-4c6a-b738-5c06a4104329 req-b00e2e01-bb6f-40e5-9d58-6202fa9b0da2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:39.747619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-aa68c74f-a3c7-4c6a-b738-5c06a4104329 req-b00e2e01-bb6f-40e5-9d58-6202fa9b0da2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:39.769917 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-aa68c74f-a3c7-4c6a-b738-5c06a4104329 req-b00e2e01-bb6f-40e5-9d58-6202fa9b0da2 service nova] Creating event network-changed:435b47ce-35db-4c9d-8774-e27fe5c158f8 for instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 on hv-cinder-84243 May 19 16:57:39.776020 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-aa68c74f-a3c7-4c6a-b738-5c06a4104329 req-b00e2e01-bb6f-40e5-9d58-6202fa9b0da2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043504 May 19 16:57:39.777240 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 725/1121] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:57:39.932553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:39.933281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:39.939679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:39.940166 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:39.940967 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:39.941451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:40.174256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:40.181641 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-00312a5a-a054-45e4-8d82-e3c67170cfbc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.253765 May 19 16:57:40.182201 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 726/1122] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:39 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:57:41.202561 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:41.203189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:41.209977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:41.210434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:41.211213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:41.211689 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:41.456350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:41.463748 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ecd21abe-eca7-4e1e-aa1f-17b5f7dbb445 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.265534 May 19 16:57:41.464547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 727/1123] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:41 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:42.480863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:42.481559 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:42.487918 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:42.488362 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:42.489120 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:42.489579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:42.617449 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:42.625106 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-505a037b-8532-43a5-b852-f12a64bc30b8 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.148041 May 19 16:57:42.625704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 728/1124] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:42 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:43.641793 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:43.642410 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:43.644417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:57:43.650208 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:43.650657 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:43.651419 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:43.651860 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:43.780913 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:43.788361 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-58f1ad33-a2f7-4c55-9ac6-e617a5f67dba tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.150459 May 19 16:57:43.788923 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 729/1125] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:43 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:44.804985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:44.805867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:44.812963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:44.813448 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:44.814222 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:44.814662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:44.947023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:44.954479 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5fc8c8d3-eec4-4164-b076-52f5be447fb9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.153394 May 19 16:57:44.955082 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 730/1126] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:44 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:45.971262 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:45.971944 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:45.978495 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:45.978953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:45.979723 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:45.980166 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:46.113539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:46.121246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b06e81a9-8a8f-44de-a850-d61e1d2992e4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.153822 May 19 16:57:46.121814 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 731/1127] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:45 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:47.137418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:47.138061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:47.140444 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=14 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:57:47.146289 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:47.146744 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:47.147508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:47.147949 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:47.278129 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:47.285579 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9cd71db5-3af4-4ae3-9f45-1a038edaee72 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.152060 May 19 16:57:47.286137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 732/1128] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:47 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:48.302731 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:48.303367 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:48.309893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:48.310350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:48.311625 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:48.312068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:48.443294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:48.450692 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e85adfb2-5c8a-482b-8655-ca7d8d00a616 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.151928 May 19 16:57:48.451256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 733/1129] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:48 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:49.467384 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:49.467965 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:49.475011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:49.475458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:49.476213 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:49.476647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:49.604468 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:49.611962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b731f027-3e79-43df-9d37-0a6e6feddb1d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.148535 May 19 16:57:49.612516 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 734/1130] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:49 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:50.629570 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:50.630325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:50.636807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:50.637299 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:50.638066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:50.638506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:50.774369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:50.781823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e53e1c09-b487-42ca-9a6a-314f450a6dbb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.156781 May 19 16:57:50.782385 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 735/1131] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:50 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:51.354465 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-b24bf05b-4dd7-403f-98ae-464a8656403d req-003a138b-755d-4139-a263-1a9add8e5465 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8d525a-8e08-4125-aaeb-0fd017f9d657", "name": "network-vif-plugged", "status": "completed", "tag": "435b47ce-35db-4c9d-8774-e27fe5c158f8"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:57:51.363987 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b24bf05b-4dd7-403f-98ae-464a8656403d req-003a138b-755d-4139-a263-1a9add8e5465 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:51.364445 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b24bf05b-4dd7-403f-98ae-464a8656403d req-003a138b-755d-4139-a263-1a9add8e5465 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:51.376143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-b24bf05b-4dd7-403f-98ae-464a8656403d req-003a138b-755d-4139-a263-1a9add8e5465 service nova] Creating event network-vif-plugged:435b47ce-35db-4c9d-8774-e27fe5c158f8 for instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 on hv-cinder-84243 May 19 16:57:51.381116 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-b24bf05b-4dd7-403f-98ae-464a8656403d req-003a138b-755d-4139-a263-1a9add8e5465 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030359 May 19 16:57:51.381930 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 736/1132] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:57:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:57:51.799843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:51.800487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:51.807103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:51.807760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:51.808553 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:51.808999 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:51.952715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:51.960684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-120a1b78-6b65-4a63-a115-4fe94e8d5989 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.166146 May 19 16:57:51.961286 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 737/1133] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:51 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:52.977911 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:52.978531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:52.985682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:52.986140 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:52.986913 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:52.987364 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:53.116977 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:53.125413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-866406c2-15cd-4869-9a08-b64e495a0460 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1263 microversion: 2.1 time: 0.150735 May 19 16:57:53.125979 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 738/1134] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:52 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:54.142432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:54.143097 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:54.149666 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:54.150060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:54.150819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:54.151256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:54.296159 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:54.304464 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3b9e8d09-7aa4-4cce-850a-4e26a7bc912c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1449 microversion: 2.1 time: 0.166528 May 19 16:57:54.305027 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 739/1135] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:54 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1449 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:54.320307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:57:54.320965 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:57:54.326587 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:54.327037 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:54.328415 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:54.328854 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:54.346406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=100 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:57:54.458057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:57:54.465454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-aaa5c464-2e4c-4187-a6f2-0d680b9ed8a7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1449 microversion: 2.1 time: 0.148568 May 19 16:57:54.466040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 740/1136] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:57:54 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1449 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:57:56.353424 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-cdc84311-e678-4b66-8438-87e199c506cc req-a912c6c7-9cde-4d30-a29e-003def70a80f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc8d525a-8e08-4125-aaeb-0fd017f9d657", "tag": "435b47ce-35db-4c9d-8774-e27fe5c158f8"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:57:56.363046 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cdc84311-e678-4b66-8438-87e199c506cc req-a912c6c7-9cde-4d30-a29e-003def70a80f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:57:56.363506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-cdc84311-e678-4b66-8438-87e199c506cc req-a912c6c7-9cde-4d30-a29e-003def70a80f service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:57:56.375124 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-cdc84311-e678-4b66-8438-87e199c506cc req-a912c6c7-9cde-4d30-a29e-003def70a80f service nova] Creating event network-changed:435b47ce-35db-4c9d-8774-e27fe5c158f8 for instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 on hv-cinder-84243 May 19 16:57:56.380245 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-cdc84311-e678-4b66-8438-87e199c506cc req-a912c6c7-9cde-4d30-a29e-003def70a80f service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030705 May 19 16:57:56.380866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 741/1137] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:58:01.403830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:58:01.404420 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:58:01.411664 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:01.412112 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:01.412911 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:01.413391 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:01.458598 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 16:58:01.544915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-17fd7457-12fb-4fc5-a951-606599ac4739 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "DELETE /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 204 len: 0 microversion: 2.1 time: 0.145770 May 19 16:58:01.545880 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 742/1138] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 16:58:01 2022] DELETE /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 16:58:01.552706 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-7bfe3893-6f52-4c9d-b42f-474a7f31334e req-da25d4bb-f790-4e28-a6f4-8353954f6009 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8395bd9a-4534-4aa5-b2d0-f08d866a9339", "tag": "bdcf063e-89c5-4dd4-8d96-078d31278d21"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:58:01.561658 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-7bfe3893-6f52-4c9d-b42f-474a7f31334e req-da25d4bb-f790-4e28-a6f4-8353954f6009 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:01.562759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-7bfe3893-6f52-4c9d-b42f-474a7f31334e req-da25d4bb-f790-4e28-a6f4-8353954f6009 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:01.574418 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-7bfe3893-6f52-4c9d-b42f-474a7f31334e req-da25d4bb-f790-4e28-a6f4-8353954f6009 service nova] Creating event network-changed:bdcf063e-89c5-4dd4-8d96-078d31278d21 for instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 on hv-cinder-84243 May 19 16:58:01.579874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-7bfe3893-6f52-4c9d-b42f-474a7f31334e req-da25d4bb-f790-4e28-a6f4-8353954f6009 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032274 May 19 16:58:01.580443 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 743/1139] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:58:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 16:58:01.585569 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:58:01.586256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:58:01.592570 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:01.593016 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:01.593908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:01.594351 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:01.732750 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:58:01.740422 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-63f9065c-bec6-41f6-987c-73e2cd7ac265 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.158905 May 19 16:58:01.740989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 744/1140] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:58:01 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 16:58:02.758822 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:58:02.759499 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:58:02.762014 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=81,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 16:58:02.767920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:02.768370 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:02.769133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:02.769589 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:03.181202 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:58:03.189142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-79e5dbfd-cca0-4aa3-bc68-569ee3a266ec tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1569 microversion: 2.1 time: 0.434242 May 19 16:58:03.189747 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 745/1141] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:58:02 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1569 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:58:03.825145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-bf426f80-5860-4448-8507-1e3e3a621778 req-cf5846eb-cae2-4d7c-b1b1-1c8fe58e1d30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8395bd9a-4534-4aa5-b2d0-f08d866a9339", "name": "network-vif-deleted", "tag": "bdcf063e-89c5-4dd4-8d96-078d31278d21"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 16:58:03.833443 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-bf426f80-5860-4448-8507-1e3e3a621778 req-cf5846eb-cae2-4d7c-b1b1-1c8fe58e1d30 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:03.833893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-bf426f80-5860-4448-8507-1e3e3a621778 req-cf5846eb-cae2-4d7c-b1b1-1c8fe58e1d30 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:03.845541 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-bf426f80-5860-4448-8507-1e3e3a621778 req-cf5846eb-cae2-4d7c-b1b1-1c8fe58e1d30 service nova] Creating event network-vif-deleted:bdcf063e-89c5-4dd4-8d96-078d31278d21 for instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 on hv-cinder-84243 May 19 16:58:03.850239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-bf426f80-5860-4448-8507-1e3e3a621778 req-cf5846eb-cae2-4d7c-b1b1-1c8fe58e1d30 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.111283 May 19 16:58:03.850802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 746/1142] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 16:58:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 16:58:04.207459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:58:04.208150 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:58:04.214402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:04.214963 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:04.215758 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:04.216192 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:04.248248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:04.248931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:04.249258 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lazy-loading 'fault' on Instance uuid 8395bd9a-4534-4aa5-b2d0-f08d866a9339 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 16:58:04.292838 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '708dbabdda134292a8259982db495e1f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f232c172df994d3d909d7999238b1935', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 16:58:04.300653 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5b822edd-7438-4c30-8d14-c82987b5c9ee tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 200 len: 1224 microversion: 2.1 time: 0.097967 May 19 16:58:04.301239 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 747/1143] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:58:04 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 1224 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 16:58:05.319177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:58:05.319791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] [instance: 8395bd9a-4534-4aa5-b2d0-f08d866a9339] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 16:58:05.326240 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:05.326696 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:05.327463 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 16:58:05.327904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 16:58:05.343557 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] HTTP exception thrown: Instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 could not be found. May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Request method failure captured: May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 HTTP/1.1 May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnWgAk_0M44G_hYqZuWCCqZq5-hYm_pcdxfCpbt5rAZ8yUWIxtggt2QEux170yVlrMn5loWPw5Ub8YCdiMBbLVK3rSxesRy-PePGbOsr53XUWddi5MibJU_udgV7Wi-i-fUYe7gPyxbcgNYpPjfjgDODNHanXOGREk7SysYctbSP3tk May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: f232c172df994d3d909d7999238b1935 May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestShelveInstance-1822735446 May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 16:58:05.345215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/f232c172df994d3d909d7999238b1935"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f232c172df994d3d909d7999238b1935"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_f232c172df994d3d909d7999238b1935", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/f232c172df994d3d909d7999238b1935"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestShelveInstance-1822735446 May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: f232c172df994d3d909d7999238b1935 May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestShelveInstance-1822735446 May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestShelveInstance-1822735446-project May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: 708dbabdda134292a8259982db495e1f May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestShelveInstance-1822735446-project May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 could not be found. May 19 16:58:05.346825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '8395bd9a-4534-4aa5-b2d0-f08d866a9339'} May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 could not be found. May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 16:58:05.347728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 could not be found. May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 could not be found. May 19 16:58:05.349389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 16:58:05.350916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Returning 404 to user: Instance 8395bd9a-4534-4aa5-b2d0-f08d866a9339 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 16:58:05.350916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a6891f40-ecae-4f28-b3ff-c9f5ba0656ba tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339" status: 404 len: 111 microversion: 2.1 time: 0.031554 May 19 16:58:05.350916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 748/1144] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 16:58:05 2022] GET /compute/v2.1/servers/8395bd9a-4534-4aa5-b2d0-f08d866a9339 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 16:58:05.507574 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-13517c19-be91-4643-856c-c1bbf7a35f29 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] Calling method '.version_select at 0x7f489c81cf70>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 16:58:05.526288 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-13517c19-be91-4643-856c-c1bbf7a35f29 tempest-TestShelveInstance-1822735446 tempest-TestShelveInstance-1822735446-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-752603937" status: 202 len: 0 microversion: 2.1 time: 0.022436 May 19 16:58:05.526866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 749/1145] 10.222.0.36 () {58 vars in 1250 bytes} [Thu May 19 16:58:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-752603937 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 17:00:10.209111 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a67cd93-c7ca-42d0-ba8c-c7d4948ce7d3] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 17:00:10.210345 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:00:10.210897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:00:10.215438 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:10.215931 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:10.225941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:10.226409 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:10.227156 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:10.227709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:10.259883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 17:00:10.339476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-73d24de8-8d45-44b5-be00-17296c683e98 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 204 len: 0 microversion: 2.1 time: 0.132063 May 19 17:00:10.340109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 750/1146] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 17:00:10 2022] DELETE /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 17:00:10.348292 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:10.348985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:10.354684 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:10.355137 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:10.355921 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:10.356351 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:10.610721 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:10.619146 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-7bb7647e-fc2f-4402-b61f-6c3fd3081b46 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1574 microversion: 2.1 time: 0.274898 May 19 17:00:10.619699 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 751/1147] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:10 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1574 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:11.636203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:11.636891 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:11.644819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:11.645306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:11.646110 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:11.646534 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:11.663728 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a67cd93-c7ca-42d0-ba8c-c7d4948ce7d3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 45894. May 19 17:00:11.777705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:11.785132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-93fdc611-499f-4777-9737-ffb3428872c9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1574 microversion: 2.1 time: 0.152989 May 19 17:00:11.785737 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 752/1148] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:11 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:12.802306 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:12.802948 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:12.810063 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:12.810518 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:12.811293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:12.811735 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:12.878722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:12.886392 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bc63b07c-553b-42f8-8f43-7f0416b986ff tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 200 len: 1508 microversion: 2.1 time: 0.087945 May 19 17:00:12.886958 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 753/1149] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:12 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 1508 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:13.036554 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-6c455403-3843-4cdd-9c98-3f48a47ac021 req-2a04c7f8-e6f2-4344-b19e-91175fc3cbb5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc8d525a-8e08-4125-aaeb-0fd017f9d657", "name": "network-vif-deleted", "tag": "435b47ce-35db-4c9d-8774-e27fe5c158f8"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:00:13.046041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6c455403-3843-4cdd-9c98-3f48a47ac021 req-2a04c7f8-e6f2-4344-b19e-91175fc3cbb5 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:13.046518 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-6c455403-3843-4cdd-9c98-3f48a47ac021 req-2a04c7f8-e6f2-4344-b19e-91175fc3cbb5 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:13.058066 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-6c455403-3843-4cdd-9c98-3f48a47ac021 req-2a04c7f8-e6f2-4344-b19e-91175fc3cbb5 service nova] Creating event network-vif-deleted:435b47ce-35db-4c9d-8774-e27fe5c158f8 for instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 on hv-cinder-84243 May 19 17:00:13.063665 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-6c455403-3843-4cdd-9c98-3f48a47ac021 req-2a04c7f8-e6f2-4344-b19e-91175fc3cbb5 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030777 May 19 17:00:13.064250 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 754/1150] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:00:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 17:00:13.904277 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:13.905080 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:13.911390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:13.911922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:13.912767 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:13.913244 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:13.927741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] HTTP exception thrown: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Request method failure captured: May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 HTTP/1.1 May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnbgp7JOuay_E7vxuJxUGgyK0q0WbhTU2TclhWX2dfz0RRBBYk6y3ceLveLRvOEFS-Kl99aGZ0pCHj6j2ruawaHQdbWnlUneMUV0z8J7rcSyU0Ks8k0Ky9CploWsjqjQ6ZzdLwvd8eZ5MIQ6hUPMKX-2XNFi4TsXsYLQvia0Mbu1Ozk May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: dc95250983234edeb99b67ff4f084416 May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 17:00:13.930040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc95250983234edeb99b67ff4f084416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc95250983234edeb99b67ff4f084416", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-2093339522 May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: dc95250983234edeb99b67ff4f084416 May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-2093339522-project May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: aaf1ce6ace6e47d6a170ce17afa5397f May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-2093339522-project May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:00:13.931811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'bc8d525a-8e08-4125-aaeb-0fd017f9d657'} May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 17:00:13.932807 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:00:13.934281 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:00:13.935584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Returning 404 to user: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 17:00:13.935584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-db6b5769-7451-4dc2-9520-eac0c0e0cfd1 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 404 len: 111 microversion: 2.1 time: 0.031902 May 19 17:00:13.935584 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 755/1151] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:13 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 17:00:14.030449 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1013540013", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-535678048", "security_groups": [{"name": "tempest-secgroup-smoke-90520039"}], "block_device_mapping_v2": [{"uuid": "afc66471-8c79-41ef-a2e8-d36128710fe8", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d06705e9-9d4e-4712-8321-c61ce7be2560"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:00:14.141916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] validate_networks() for [('d06705e9-9d4e-4712-8321-c61ce7be2560', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 17:00:14.564012 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 17:00:14.564440 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 17:00:14.564918 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 17:00:14.565375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 17:00:14.565790 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 17:00:14.574580 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:14.575032 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:14.575830 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:14.576270 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:14.593131 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for project dc95250983234edeb99b67ff4f084416. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 17:00:14.597088 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for user aaf1ce6ace6e47d6a170ce17afa5397f and project dc95250983234edeb99b67ff4f084416. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 17:00:14.654142 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 17:00:14.656272 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='afc66471-8c79-41ef-a2e8-d36128710fe8',volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 17:00:14.794778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-c2a81f49-d47a-451c-90e8-0bf6c304c99c tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.768071 May 19 17:00:14.795590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 756/1152] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 17:00:14 2022] POST /compute/v2.1/servers => generated 404 bytes in 770 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 17:00:14.805061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a7fabed8-f83d-4bd4-acf5-be55f4c48717 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:14.805702 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a7fabed8-f83d-4bd4-acf5-be55f4c48717 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:14.860586 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a7fabed8-f83d-4bd4-acf5-be55f4c48717 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:14.867484 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a7fabed8-f83d-4bd4-acf5-be55f4c48717 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1094 microversion: 2.1 time: 0.066149 May 19 17:00:14.868719 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 757/1153] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:14 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1094 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:15.887328 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:15.888606 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:15.897614 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:15.898107 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:15.899337 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:15.900054 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:15.971112 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:15.978843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72ce0e23-b9ad-45d1-80e0-95df597baa11 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1210 microversion: 2.1 time: 0.097364 May 19 17:00:15.979492 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 758/1154] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:15 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1210 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:16.996171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:16.997732 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:17.004695 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:17.005171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:17.006011 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:17.006451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:17.172278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:17.187312 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ac96eca6-001b-44d8-9477-be7e5646770d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.195278 May 19 17:00:17.188103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 759/1155] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:16 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:17.193247 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-889fb44a-7bed-45b6-a300-9b8906f538c6 req-c7bf6fb2-e9b7-4b97-a9af-ba8fd53e68ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8967ee-efd2-4b7a-8a77-b21e03588a67", "tag": "accb8d36-4ef0-487e-bb7e-e2f94c12f717"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:00:17.202989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-889fb44a-7bed-45b6-a300-9b8906f538c6 req-c7bf6fb2-e9b7-4b97-a9af-ba8fd53e68ff service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:17.203774 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-889fb44a-7bed-45b6-a300-9b8906f538c6 req-c7bf6fb2-e9b7-4b97-a9af-ba8fd53e68ff service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:17.216298 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-889fb44a-7bed-45b6-a300-9b8906f538c6 req-c7bf6fb2-e9b7-4b97-a9af-ba8fd53e68ff service nova] Creating event network-changed:accb8d36-4ef0-487e-bb7e-e2f94c12f717 for instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 on hv-cinder-84243 May 19 17:00:17.221453 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-889fb44a-7bed-45b6-a300-9b8906f538c6 req-c7bf6fb2-e9b7-4b97-a9af-ba8fd53e68ff service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031872 May 19 17:00:17.222114 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 760/1156] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:00:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 17:00:18.205727 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:18.206398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:18.213010 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:18.213488 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:18.214247 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:18.214688 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:18.346273 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:18.354431 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-1c8a61c8-c677-4f55-a663-dba8ddced5db tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.153401 May 19 17:00:18.355001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 761/1157] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:18 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:19.371135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:19.371813 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:19.378278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:19.378726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:19.379508 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:19.379942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:19.520804 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:19.528975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5e5ccc69-e957-44fb-b343-c2ea9b0f2e74 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.161899 May 19 17:00:19.529578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 762/1158] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:19 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:20.545819 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:20.546485 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:20.552929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:20.553439 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:20.554205 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:20.554645 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:20.682171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:20.689595 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-3113c893-0d2f-4147-b2e5-21c96abaff4d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.147631 May 19 17:00:20.690150 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 763/1159] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:20 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:21.706013 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:21.706704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:21.713715 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:21.714160 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:21.714916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:21.715350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:21.847514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:21.855806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-dcd13aa5-d75d-4aef-b29e-87044d0b6cdf tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.153679 May 19 17:00:21.856369 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 764/1160] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:21 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:22.872682 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:22.873402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:22.879725 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:22.880171 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:22.880929 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:22.881395 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:23.015778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:23.023098 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-864bfec7-f2a7-410a-a156-b44b80f10948 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.154296 May 19 17:00:23.024241 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 765/1161] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:22 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:24.039985 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:24.040608 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:24.047177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:24.047636 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:24.048409 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:24.048858 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:24.175989 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:24.183933 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-72421fb4-3a75-4ea1-94a7-fe2cb26373b5 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.147866 May 19 17:00:24.184501 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 766/1162] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:24 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:25.199794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:25.200411 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:25.202398 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:00:25.203113 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:00:25.209986 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:25.210446 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:25.211227 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:25.211669 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:25.347489 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:25.355428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-65ae70a6-0571-4db8-8f62-10777e16eb88 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.159512 May 19 17:00:25.355995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 767/1163] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:25 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:26.372040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:26.372662 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:26.379219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:26.379678 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:26.380447 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:26.380920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:26.399242 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:00:26.514272 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:26.521890 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6974f425-0882-47c4-848b-a76e99267010 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.153974 May 19 17:00:26.522458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 768/1164] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:26 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:27.539023 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:27.539679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:27.546083 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:27.546537 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:27.547325 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:27.547759 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:27.680397 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:27.688048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-6f5d1782-42e9-4897-b33e-ad6715f7591f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.152971 May 19 17:00:27.688620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 769/1165] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:27 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:28.163412 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-008d6a9d-fa09-4e36-bfc9-73474fe48b13 req-a272fe96-5290-425f-9c5e-67445d7353e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8967ee-efd2-4b7a-8a77-b21e03588a67", "name": "network-vif-plugged", "status": "completed", "tag": "accb8d36-4ef0-487e-bb7e-e2f94c12f717"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:00:28.171922 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-008d6a9d-fa09-4e36-bfc9-73474fe48b13 req-a272fe96-5290-425f-9c5e-67445d7353e2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:28.172365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-008d6a9d-fa09-4e36-bfc9-73474fe48b13 req-a272fe96-5290-425f-9c5e-67445d7353e2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:28.183389 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-008d6a9d-fa09-4e36-bfc9-73474fe48b13 req-a272fe96-5290-425f-9c5e-67445d7353e2 service nova] Creating event network-vif-plugged:accb8d36-4ef0-487e-bb7e-e2f94c12f717 for instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 on hv-cinder-84243 May 19 17:00:28.188284 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-008d6a9d-fa09-4e36-bfc9-73474fe48b13 req-a272fe96-5290-425f-9c5e-67445d7353e2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093299 May 19 17:00:28.188845 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 770/1166] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 17:00:28.706365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:28.706982 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:28.713691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:28.714143 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:28.714904 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:28.715343 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:28.854037 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:28.861515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-651ba4dd-e55d-4602-91b6-35541a5e0343 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1264 microversion: 2.1 time: 0.159903 May 19 17:00:28.862073 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 771/1167] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:28 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:29.878416 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:29.879097 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:29.885722 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:29.886177 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:29.886966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:29.887402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:30.023802 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:30.037962 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-805df99c-bb8d-414f-b03f-8a1d529b9ab3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1450 microversion: 2.1 time: 0.163402 May 19 17:00:30.038761 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 772/1168] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:29 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1450 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:30.057184 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:00:30.057806 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:00:30.063694 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:30.064146 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:30.064910 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:30.065375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:30.196487 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:00:30.203932 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-07a188e2-c40a-4685-89c2-049d811c0bfa tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1450 microversion: 2.1 time: 0.151070 May 19 17:00:30.204526 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 773/1169] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:00:30 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:00:31.838895 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-85ae29f6-eb99-4ff8-bbb1-d86263fa577b req-abb16baa-9e19-423d-95d7-39d7e25c2ae2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8967ee-efd2-4b7a-8a77-b21e03588a67", "tag": "accb8d36-4ef0-487e-bb7e-e2f94c12f717"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:00:31.847264 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-85ae29f6-eb99-4ff8-bbb1-d86263fa577b req-abb16baa-9e19-423d-95d7-39d7e25c2ae2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:00:31.847713 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-85ae29f6-eb99-4ff8-bbb1-d86263fa577b req-abb16baa-9e19-423d-95d7-39d7e25c2ae2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:00:31.860454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-85ae29f6-eb99-4ff8-bbb1-d86263fa577b req-abb16baa-9e19-423d-95d7-39d7e25c2ae2 service nova] Creating event network-changed:accb8d36-4ef0-487e-bb7e-e2f94c12f717 for instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 on hv-cinder-84243 May 19 17:00:31.865647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-85ae29f6-eb99-4ff8-bbb1-d86263fa577b req-abb16baa-9e19-423d-95d7-39d7e25c2ae2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085436 May 19 17:00:31.866322 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 774/1170] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 17:02:31.679482 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a67cd93-c7ca-42d0-ba8c-c7d4948ce7d3] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 17:02:31.680169 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=70,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:02:31.680896 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=30 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:02:31.685459 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-982024720", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-535678048", "security_groups": [{"name": "tempest-secgroup-smoke-90520039"}], "block_device_mapping_v2": [{"uuid": "172c708e-01ab-447d-bca8-1989f9cc5dcd", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "d06705e9-9d4e-4712-8321-c61ce7be2560"}]}} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:02:31.806851 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.network.neutron [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] validate_networks() for [('d06705e9-9d4e-4712-8321-c61ce7be2560', None, None, None, None, None)] {{(pid=124122) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 19 17:02:32.171379 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Flavor limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 19 17:02:32.171803 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Image limits 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 19 17:02:32.172278 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Flavor pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 19 17:02:32.172686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Image pref 0:0:0 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 19 17:02:32.173099 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.virt.hardware [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124122) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 19 17:02:32.181843 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:32.182293 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:32.183085 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:32.183520 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:32.201041 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for project dc95250983234edeb99b67ff4f084416. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 19 17:02:32.204946 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.quota [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Getting quotas for user aaf1ce6ace6e47d6a170ce17afa5397f and project dc95250983234edeb99b67ff4f084416. Resources: {'cores', 'ram', 'instances'} {{(pid=124122) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 19 17:02:32.262132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Going to run 1 instances... {{(pid=124122) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 19 17:02:32.264280 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='172c708e-01ab-447d-bca8-1989f9cc5dcd',volume_size=None,volume_type=None)] {{(pid=124122) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 19 17:02:32.387203 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-463a3d40-361d-40f0-93a0-32e758f1dfb7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 0.709475 May 19 17:02:32.387835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 775/1171] 10.222.0.36 () {60 vars in 1146 bytes} [Thu May 19 17:02:31 2022] POST /compute/v2.1/servers => generated 404 bytes in 711 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 19 17:02:32.397518 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f8771465-9978-4e40-bcab-d9c8bc159181 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:32.398130 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f8771465-9978-4e40-bcab-d9c8bc159181 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:32.450147 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f8771465-9978-4e40-bcab-d9c8bc159181 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:32.457413 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f8771465-9978-4e40-bcab-d9c8bc159181 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1093 microversion: 2.1 time: 0.063477 May 19 17:02:32.457973 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 776/1172] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:32 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1093 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 17:02:33.474243 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:33.474892 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:33.482596 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:33.483051 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:33.483825 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:33.484265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:33.490349 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a67cd93-c7ca-42d0-ba8c-c7d4948ce7d3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46074. May 19 17:02:33.553313 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:33.561302 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a51bd5d9-bc56-4563-8e08-3a01b9c25bfc tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1209 microversion: 2.1 time: 0.090949 May 19 17:02:33.561863 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 777/1173] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:33 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1209 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:34.578898 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:34.579590 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:34.586402 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:34.586865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:34.587650 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:34.597915 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:34.745879 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:34.754090 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-813c57d4-f2ad-4f10-8ff1-9f6e6ace0eb3 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.179012 May 19 17:02:34.754679 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 778/1174] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:34 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:34.759323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-51c217b9-206e-4163-9c06-0dba7b8d274f req-689a0761-c37b-4709-8386-d60bc9690e47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58d8340-93f7-4b2f-9fad-334a6adc200a", "tag": "aace3b3f-e6b4-43f5-93d8-0d231d786781"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:02:34.774046 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-51c217b9-206e-4163-9c06-0dba7b8d274f req-689a0761-c37b-4709-8386-d60bc9690e47 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:34.774789 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-51c217b9-206e-4163-9c06-0dba7b8d274f req-689a0761-c37b-4709-8386-d60bc9690e47 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:34.787778 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-51c217b9-206e-4163-9c06-0dba7b8d274f req-689a0761-c37b-4709-8386-d60bc9690e47 service nova] Creating event network-changed:aace3b3f-e6b4-43f5-93d8-0d231d786781 for instance f58d8340-93f7-4b2f-9fad-334a6adc200a on hv-cinder-84243 May 19 17:02:34.793705 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-51c217b9-206e-4163-9c06-0dba7b8d274f req-689a0761-c37b-4709-8386-d60bc9690e47 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037657 May 19 17:02:34.794319 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 779/1175] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:02:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 17:02:35.772146 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:35.773473 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:35.779741 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:35.780196 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:35.780964 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:35.781451 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:35.911514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:35.918856 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ce1db91a-e504-45f9-b80d-fe63dea2a92e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.151392 May 19 17:02:35.919407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 780/1176] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:35 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:36.935768 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:36.936374 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:36.942882 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:36.943342 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:36.944154 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:36.945335 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:37.076039 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:37.083564 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-86633ea0-be52-4910-9e6d-536cb91827b6 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.151648 May 19 17:02:37.084132 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 781/1177] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:36 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:38.099755 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:38.100410 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:38.106956 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:38.107414 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:38.108187 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:38.108629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:38.236571 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:38.244738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9ece9586-1c5b-433f-a07e-b70630118722 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.148892 May 19 17:02:38.245326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 782/1178] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:38 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:39.262109 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:39.262760 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:39.269307 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:39.269772 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:39.270547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:39.270993 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:39.402433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:39.409911 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d447bb19-bbdf-4e0e-ad81-385705d816d7 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.151704 May 19 17:02:39.410476 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 783/1179] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:39 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:40.427099 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:40.427757 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:40.434256 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:40.434717 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:40.435489 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:40.435961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:40.562893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:40.570941 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-610b5870-96f5-4183-b780-222525aca27e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.147711 May 19 17:02:40.571512 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 784/1180] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:40 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:41.588145 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:41.588800 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:41.595182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:41.595644 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:41.596433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:41.596867 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:41.726480 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:41.733969 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-a5dadb92-f419-40ca-a845-a98c1e6c6b6d tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.150274 May 19 17:02:41.734531 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 785/1181] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:41 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:42.751181 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:42.751829 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:42.753881 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=2 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:02:42.754667 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell0:SELECT=8 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:02:42.762483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:42.762950 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:42.763737 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:42.764210 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:42.904127 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:42.911691 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-20de6cd2-20fa-42a8-989a-ffe4d4bba07f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.164516 May 19 17:02:42.912254 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 786/1182] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:42 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:43.927829 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:43.928434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:43.934974 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:43.935452 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:43.936219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:43.936660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:44.071551 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:44.080483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-f154085a-2b79-42a2-9160-082a1f10964e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.156450 May 19 17:02:44.081061 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 787/1183] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:43 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:44.755866 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-0f3ecdec-a1ff-44fb-92b5-e4835e4b0fae req-cea88dfa-456e-47a7-9ea3-184e8ed687b2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58d8340-93f7-4b2f-9fad-334a6adc200a", "name": "network-vif-plugged", "status": "completed", "tag": "aace3b3f-e6b4-43f5-93d8-0d231d786781"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:02:44.764542 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0f3ecdec-a1ff-44fb-92b5-e4835e4b0fae req-cea88dfa-456e-47a7-9ea3-184e8ed687b2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:44.764995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-0f3ecdec-a1ff-44fb-92b5-e4835e4b0fae req-cea88dfa-456e-47a7-9ea3-184e8ed687b2 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:44.776549 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-0f3ecdec-a1ff-44fb-92b5-e4835e4b0fae req-cea88dfa-456e-47a7-9ea3-184e8ed687b2 service nova] Creating event network-vif-plugged:aace3b3f-e6b4-43f5-93d8-0d231d786781 for instance f58d8340-93f7-4b2f-9fad-334a6adc200a on hv-cinder-84243 May 19 17:02:44.781588 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-0f3ecdec-a1ff-44fb-92b5-e4835e4b0fae req-cea88dfa-456e-47a7-9ea3-184e8ed687b2 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029463 May 19 17:02:44.782169 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 788/1184] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:02:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 17:02:45.098914 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:45.099618 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:45.105839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:45.106290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:45.107053 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:45.107493 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:45.467002 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:45.474519 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-198baa58-9805-443c-9534-871d9bb38587 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.380353 May 19 17:02:45.475086 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 789/1185] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:45 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:46.492141 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:46.492831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:46.499360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:46.499823 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:46.500600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:46.501048 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:46.628566 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:46.636792 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-921df985-a4cb-4da1-aa9a-f87d5540c1d9 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1263 microversion: 2.1 time: 0.148992 May 19 17:02:46.637406 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 790/1186] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:46 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1263 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:47.653518 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:47.654186 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:47.660568 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:47.661021 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:47.661809 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:47.662246 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:47.792884 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:47.800375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9b8adeaa-6a12-4027-bd68-e711869d4916 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1450 microversion: 2.1 time: 0.150716 May 19 17:02:47.800942 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 791/1187] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:47 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1450 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:47.816788 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:02:47.817428 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:02:47.823152 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:47.823599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:47.824354 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:47.824791 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:47.951887 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:02:47.959432 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-e091fa36-d1f6-4338-a664-63669bc28d66 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1450 microversion: 2.1 time: 0.146151 May 19 17:02:47.960506 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 792/1188] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:02:47 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1450 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:02:49.530483 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-fac14623-953f-4983-82c9-fad3cd7ac9ad req-a07d5a55-6838-465d-845e-c8ed9e73fbe3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58d8340-93f7-4b2f-9fad-334a6adc200a", "tag": "aace3b3f-e6b4-43f5-93d8-0d231d786781"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:02:49.539535 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fac14623-953f-4983-82c9-fad3cd7ac9ad req-a07d5a55-6838-465d-845e-c8ed9e73fbe3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:02:49.539980 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-fac14623-953f-4983-82c9-fad3cd7ac9ad req-a07d5a55-6838-465d-845e-c8ed9e73fbe3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:02:49.551323 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-fac14623-953f-4983-82c9-fad3cd7ac9ad req-a07d5a55-6838-465d-845e-c8ed9e73fbe3 service nova] Creating event network-changed:aace3b3f-e6b4-43f5-93d8-0d231d786781 for instance f58d8340-93f7-4b2f-9fad-334a6adc200a on hv-cinder-84243 May 19 17:02:49.556197 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-fac14623-953f-4983-82c9-fad3cd7ac9ad req-a07d5a55-6838-465d-845e-c8ed9e73fbe3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029359 May 19 17:02:49.556835 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 793/1189] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 17:03:16.540100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 17:03:16.540797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Thu May 19 17:03:16 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 17:04:41.483810 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR oslo.messaging._drivers.impl_rabbit [-] [8a67cd93-c7ca-42d0-ba8c-c7d4948ce7d3] AMQP server on 10.222.0.36:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed May 19 17:04:41.484547 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:04:41.485515 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG dbcounter [-] [124122] Writing DB stats nova_cell1:SELECT=92 {{(pid=124122) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 19 17:04:41.491179 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:41.491784 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:41.499339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:41.499794 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:41.500578 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:41.501133 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:41.529134 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 17:04:41.606026 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-b496f5a4-7fe1-4f63-87f6-383fe140840a tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "DELETE /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 204 len: 0 microversion: 2.1 time: 0.124752 May 19 17:04:41.609255 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 794/1190] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 17:04:41 2022] DELETE /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 19 17:04:41.612029 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-452ed087-8d2b-49b1-ae7b-fd5e2e3246bf req-696324e1-a7c4-48e3-9a69-662556552ef3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f58d8340-93f7-4b2f-9fad-334a6adc200a", "tag": "aace3b3f-e6b4-43f5-93d8-0d231d786781"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:04:41.622104 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-452ed087-8d2b-49b1-ae7b-fd5e2e3246bf req-696324e1-a7c4-48e3-9a69-662556552ef3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:41.622729 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-452ed087-8d2b-49b1-ae7b-fd5e2e3246bf req-696324e1-a7c4-48e3-9a69-662556552ef3 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:41.634360 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-452ed087-8d2b-49b1-ae7b-fd5e2e3246bf req-696324e1-a7c4-48e3-9a69-662556552ef3 service nova] Creating event network-changed:aace3b3f-e6b4-43f5-93d8-0d231d786781 for instance f58d8340-93f7-4b2f-9fad-334a6adc200a on hv-cinder-84243 May 19 17:04:41.643865 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-452ed087-8d2b-49b1-ae7b-fd5e2e3246bf req-696324e1-a7c4-48e3-9a69-662556552ef3 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036028 May 19 17:04:41.644820 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 795/1191] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 17:04:41.651148 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:41.651839 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:41.657951 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:41.658407 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:41.659163 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:41.659596 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:41.798920 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:04:41.807057 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-ad712402-ce2d-4508-bd8c-cd38d34f8163 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1575 microversion: 2.1 time: 0.161256 May 19 17:04:41.807910 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 796/1192] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:41 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1575 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 17:04:42.824296 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:42.824926 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:42.835966 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:42.836637 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:42.837628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:42.838072 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:42.842138 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] [8a67cd93-c7ca-42d0-ba8c-c7d4948ce7d3] Reconnected to AMQP server on 10.222.0.36:5672 via [amqp] client with port 46162. May 19 17:04:42.971326 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:04:42.978897 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2cb6974c-0b2b-4f59-afdf-790972fecb3e tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1575 microversion: 2.1 time: 0.158391 May 19 17:04:42.979474 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 797/1193] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:42 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:04:43.961695 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-b0f9d580-fd8c-4b35-a736-333600a480c5 req-bc69fdd4-b6d9-4649-a99d-09e9cd29b2fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f58d8340-93f7-4b2f-9fad-334a6adc200a", "name": "network-vif-deleted", "tag": "aace3b3f-e6b4-43f5-93d8-0d231d786781"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:04:43.969686 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b0f9d580-fd8c-4b35-a736-333600a480c5 req-bc69fdd4-b6d9-4649-a99d-09e9cd29b2fa service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:43.970135 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-b0f9d580-fd8c-4b35-a736-333600a480c5 req-bc69fdd4-b6d9-4649-a99d-09e9cd29b2fa service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:43.980797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-b0f9d580-fd8c-4b35-a736-333600a480c5 req-bc69fdd4-b6d9-4649-a99d-09e9cd29b2fa service nova] Creating event network-vif-deleted:aace3b3f-e6b4-43f5-93d8-0d231d786781 for instance f58d8340-93f7-4b2f-9fad-334a6adc200a on hv-cinder-84243 May 19 17:04:43.985627 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-b0f9d580-fd8c-4b35-a736-333600a480c5 req-bc69fdd4-b6d9-4649-a99d-09e9cd29b2fa service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.117161 May 19 17:04:43.986381 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 798/1194] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:04:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 17:04:43.997042 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:43.997773 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:44.003797 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:44.004260 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:44.005028 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:44.006103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:44.066216 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:04:44.074472 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-311e4f99-7eb5-4669-a0a8-54d617b8cd01 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 200 len: 1224 microversion: 2.1 time: 0.081204 May 19 17:04:44.074995 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 799/1195] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:43 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 1224 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:04:45.091350 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:45.092040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: f58d8340-93f7-4b2f-9fad-334a6adc200a] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:45.098433 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:45.098871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:45.099629 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:45.100065 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:45.112970 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] HTTP exception thrown: Instance f58d8340-93f7-4b2f-9fad-334a6adc200a could not be found. May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Request method failure captured: May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a HTTP/1.1 May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnbgp7JOuay_E7vxuJxUGgyK0q0WbhTU2TclhWX2dfz0RRBBYk6y3ceLveLRvOEFS-Kl99aGZ0pCHj6j2ruawaHQdbWnlUneMUV0z8J7rcSyU0Ks8k0Ky9CploWsjqjQ6ZzdLwvd8eZ5MIQ6hUPMKX-2XNFi4TsXsYLQvia0Mbu1Ozk May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 17:04:45.114849 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc95250983234edeb99b67ff4f084416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc95250983234edeb99b67ff4f084416", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: aaf1ce6ace6e47d6a170ce17afa5397f May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance f58d8340-93f7-4b2f-9fad-334a6adc200a could not be found. May 19 17:04:45.116434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'f58d8340-93f7-4b2f-9fad-334a6adc200a'} May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f58d8340-93f7-4b2f-9fad-334a6adc200a could not be found. May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 17:04:45.117339 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f58d8340-93f7-4b2f-9fad-334a6adc200a could not be found. May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f58d8340-93f7-4b2f-9fad-334a6adc200a could not be found. May 19 17:04:45.119183 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:45.120681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Returning 404 to user: Instance f58d8340-93f7-4b2f-9fad-334a6adc200a could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 17:04:45.120681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-9504bc1d-e12a-4e17-8627-cbd53d58c2f4 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a" status: 404 len: 111 microversion: 2.1 time: 0.028783 May 19 17:04:45.120681 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 800/1196] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:45 2022] GET /compute/v2.1/servers/f58d8340-93f7-4b2f-9fad-334a6adc200a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 17:04:48.147840 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:48.148454 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:48.155546 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:48.156077 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:48.156943 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:48.157478 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:48.184491 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Going to try to terminate instance {{(pid=124122) delete /opt/stack/nova/nova/compute/api.py:2664}} May 19 17:04:48.261265 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-2fdd4c44-0a93-4725-a505-9d16bc4413cb tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "DELETE /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 204 len: 0 microversion: 2.1 time: 0.117535 May 19 17:04:48.262567 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 801/1197] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 17:04:48 2022] DELETE /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 19 17:04:48.269607 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-44b3110b-5018-4f33-856c-940c034b0821 req-6c8aad91-5d0f-43f2-b95c-0c3eeb346302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f8967ee-efd2-4b7a-8a77-b21e03588a67", "tag": "accb8d36-4ef0-487e-bb7e-e2f94c12f717"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:04:48.278975 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-44b3110b-5018-4f33-856c-940c034b0821 req-6c8aad91-5d0f-43f2-b95c-0c3eeb346302 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:48.279434 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-44b3110b-5018-4f33-856c-940c034b0821 req-6c8aad91-5d0f-43f2-b95c-0c3eeb346302 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:48.290868 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-44b3110b-5018-4f33-856c-940c034b0821 req-6c8aad91-5d0f-43f2-b95c-0c3eeb346302 service nova] Creating event network-changed:accb8d36-4ef0-487e-bb7e-e2f94c12f717 for instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 on hv-cinder-84243 May 19 17:04:48.295620 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-44b3110b-5018-4f33-856c-940c034b0821 req-6c8aad91-5d0f-43f2-b95c-0c3eeb346302 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031770 May 19 17:04:48.296204 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 802/1198] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:04:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 19 17:04:48.301100 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:48.301818 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:48.308690 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:48.309512 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:48.309953 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:48.310543 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:48.446376 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:04:48.454247 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-bf1300f1-20e1-40ad-9570-310c529deb67 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1575 microversion: 2.1 time: 0.156876 May 19 17:04:48.454832 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 803/1199] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:48 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 19 17:04:49.472189 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:49.472871 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:49.479599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:49.480600 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:49.482175 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:49.482626 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:49.610811 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:04:49.620458 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-5ec5ea1c-d6fe-461c-86c5-a960b49d536b tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1575 microversion: 2.1 time: 0.152101 May 19 17:04:49.621035 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 804/1200] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:49 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:04:50.310875 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [req-ffdecfa9-6896-4445-aefc-dbe12b415211 req-1d3a89fa-2b2c-497f-b616-a56daf8232d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f8967ee-efd2-4b7a-8a77-b21e03588a67", "name": "network-vif-deleted", "tag": "accb8d36-4ef0-487e-bb7e-e2f94c12f717"}]} {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 19 17:04:50.319365 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ffdecfa9-6896-4445-aefc-dbe12b415211 req-1d3a89fa-2b2c-497f-b616-a56daf8232d7 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:50.319816 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [req-ffdecfa9-6896-4445-aefc-dbe12b415211 req-1d3a89fa-2b2c-497f-b616-a56daf8232d7 service nova] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:50.331219 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.compute.server_external_events [req-ffdecfa9-6896-4445-aefc-dbe12b415211 req-1d3a89fa-2b2c-497f-b616-a56daf8232d7 service nova] Creating event network-vif-deleted:accb8d36-4ef0-487e-bb7e-e2f94c12f717 for instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 on hv-cinder-84243 May 19 17:04:50.336009 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [req-ffdecfa9-6896-4445-aefc-dbe12b415211 req-1d3a89fa-2b2c-497f-b616-a56daf8232d7 service nova] 10.222.0.36 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028859 May 19 17:04:50.336619 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 805/1201] 10.222.0.36 () {64 vars in 1317 bytes} [Thu May 19 17:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 19 17:04:50.638545 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:50.639248 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:50.645704 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:50.646182 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:50.647481 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:50.647916 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:50.680883 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:50.681375 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:50.681893 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.objects.instance [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lazy-loading 'fault' on Instance uuid 6f8967ee-efd2-4b7a-8a77-b21e03588a67 {{(pid=124122) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 19 17:04:50.723815 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.policy [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'aaf1ce6ace6e47d6a170ce17afa5397f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'dc95250983234edeb99b67ff4f084416', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124122) authorize /opt/stack/nova/nova/policy.py:199}} May 19 17:04:50.731954 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-45c640a9-1818-4543-9be3-43d14625a459 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 200 len: 1230 microversion: 2.1 time: 0.098154 May 19 17:04:50.732510 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 806/1202] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:50 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 1230 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 19 17:04:51.751083 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:51.751726 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: 6f8967ee-efd2-4b7a-8a77-b21e03588a67] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:51.759164 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:51.759628 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:51.760390 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:51.760831 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:51.774417 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] HTTP exception thrown: Instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 could not be found. May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Request method failure captured: May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 HTTP/1.1 May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnbgp7JOuay_E7vxuJxUGgyK0q0WbhTU2TclhWX2dfz0RRBBYk6y3ceLveLRvOEFS-Kl99aGZ0pCHj6j2ruawaHQdbWnlUneMUV0z8J7rcSyU0Ks8k0Ky9CploWsjqjQ6ZzdLwvd8eZ5MIQ6hUPMKX-2XNFi4TsXsYLQvia0Mbu1Ozk May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 17:04:51.776025 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc95250983234edeb99b67ff4f084416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc95250983234edeb99b67ff4f084416", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: aaf1ce6ace6e47d6a170ce17afa5397f May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 could not be found. May 19 17:04:51.777901 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': '6f8967ee-efd2-4b7a-8a77-b21e03588a67'} May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 could not be found. May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 17:04:51.778961 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 could not be found. May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 could not be found. May 19 17:04:51.780647 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:51.782198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Returning 404 to user: Instance 6f8967ee-efd2-4b7a-8a77-b21e03588a67 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 17:04:51.782198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-daf96396-cb65-41c3-b601-d77b95b4ee47 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67" status: 404 len: 111 microversion: 2.1 time: 0.030398 May 19 17:04:51.782198 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 807/1203] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:51 2022] GET /compute/v2.1/servers/6f8967ee-efd2-4b7a-8a77-b21e03588a67 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 17:04:52.432597 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:52.433096 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:52.439068 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:52.439524 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:52.440294 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:52.440738 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:52.456635 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] HTTP exception thrown: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Request method failure captured: May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: DELETE /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 HTTP/1.1 May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnbgp7JOuay_E7vxuJxUGgyK0q0WbhTU2TclhWX2dfz0RRBBYk6y3ceLveLRvOEFS-Kl99aGZ0pCHj6j2ruawaHQdbWnlUneMUV0z8J7rcSyU0Ks8k0Ky9CploWsjqjQ6ZzdLwvd8eZ5MIQ6hUPMKX-2XNFi4TsXsYLQvia0Mbu1Ozk May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 17:04:52.458188 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc95250983234edeb99b67ff4f084416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc95250983234edeb99b67ff4f084416", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: aaf1ce6ace6e47d6a170ce17afa5397f May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.460372 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'bc8d525a-8e08-4125-aaeb-0fd017f9d657'} May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 17:04:52.461496 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.463103 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.464874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Returning 404 to user: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 17:04:52.464874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-d071038d-c02e-416e-9f53-41b758b71570 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "DELETE /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 404 len: 111 microversion: 2.1 time: 0.031352 May 19 17:04:52.464874 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 808/1204] 10.222.0.36 () {58 vars in 1238 bytes} [Thu May 19 17:04:52 2022] DELETE /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 17:04:52.468060 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:52.468660 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.compute.api [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] [instance: bc8d525a-8e08-4125-aaeb-0fd017f9d657] Fetching instance by UUID {{(pid=124122) get /opt/stack/nova/nova/compute/api.py:2920}} May 19 17:04:52.474290 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:52.474780 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:52.475539 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 19 17:04:52.475980 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG oslo_concurrency.lockutils [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Lock "3b5ff4c6-24cc-4cd2-b226-22d75c194482" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124122) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 19 17:04:52.491193 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.wsgi [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] HTTP exception thrown: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Request method failure captured: May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: request: GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 HTTP/1.1 May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept: application/json May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Accept-Encoding: identity May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Connection: close May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Length: 0 May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Content-Type: application/json May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Host: 10.222.0.36 May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Openstack-System-Scope: None May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: User-Agent: python-urllib3/1.26.9 May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Auth-Token: gAAAAABihnbgp7JOuay_E7vxuJxUGgyK0q0WbhTU2TclhWX2dfz0RRBBYk6y3ceLveLRvOEFS-Kl99aGZ0pCHj6j2ruawaHQdbWnlUneMUV0z8J7rcSyU0Ks8k0Ky9CploWsjqjQ6ZzdLwvd8eZ5MIQ6hUPMKX-2XNFi4TsXsYLQvia0Mbu1Ozk May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Id: None May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Domain-Name: None May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Identity-Status: Confirmed May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Is-Admin-Project: True May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Id: default May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Domain-Name: Default May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Project-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Role: reader,member May 19 17:04:52.492709 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Roles: reader,member May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Service-Catalog: [{"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2/dc95250983234edeb99b67ff4f084416"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36:8080/v1/AUTH_dc95250983234edeb99b67ff4f084416", "adminURL": "http://10.222.0.36:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/compute/v2.1"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/volume/v3/dc95250983234edeb99b67ff4f084416"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/identity"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/placement"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.36/image"}]}] May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Id: dc95250983234edeb99b67ff4f084416 May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-Tenant-Name: tempest-TestVolumeBootPattern-2093339522 May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Id: default May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Domain-Name: Default May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Id: aaf1ce6ace6e47d6a170ce17afa5397f May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: X-User-Name: tempest-TestVolumeBootPattern-2093339522-project May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: method: > May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: exception: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.494456 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: action_args: {'id': 'bc8d525a-8e08-4125-aaeb-0fd017f9d657'} May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 19 17:04:52.495599 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. May 19 17:04:52.497215 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: ERROR nova.api.openstack.wsgi May 19 17:04:52.499332 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Returning 404 to user: Instance bc8d525a-8e08-4125-aaeb-0fd017f9d657 could not be found. {{(pid=124122) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 19 17:04:52.499332 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-21e579fd-04c2-48f1-bc02-2c015bf05a63 tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657" status: 404 len: 111 microversion: 2.1 time: 0.029421 May 19 17:04:52.499332 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 809/1205] 10.222.0.36 () {58 vars in 1235 bytes} [Thu May 19 17:04:52 2022] GET /compute/v2.1/servers/bc8d525a-8e08-4125-aaeb-0fd017f9d657 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 19 17:04:53.785455 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: DEBUG nova.api.openstack.wsgi [None req-8c703401-9d11-4d09-a613-cad3284f263f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] Calling method '.version_select at 0x7f489340eee0>' {{(pid=124122) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 19 17:04:53.811380 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO nova.api.openstack.requestlog [None req-8c703401-9d11-4d09-a613-cad3284f263f tempest-TestVolumeBootPattern-2093339522 tempest-TestVolumeBootPattern-2093339522-project] 10.222.0.36 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-535678048" status: 202 len: 0 microversion: 2.1 time: 0.029682 May 19 17:04:53.812283 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: [pid: 124122|app: 0|req: 810/1206] 10.222.0.36 () {58 vars in 1259 bytes} [Thu May 19 17:04:53 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-535678048 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 19 17:08:13.059908 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 17:08:13.060514 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Thu May 19 17:08:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 17:09:56.552300 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 17:09:56.553001 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Thu May 19 17:09:56 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 19 17:10:06.563363 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 19 17:10:06.564040 dv-cinder-842433-1-iscsi devstack@n-api.service[124122]: Thu May 19 17:10:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!